“Flash Attention is planned for inclusion in the official PyTorch 2.0 release, scheduled for March.”