“Flash Attention performs more floating-point operations (FLOPs) than standard attention due to recomputation, but it runs approximately 6x faster because it reduces memory reads and writes by about 9x.”