“The block size in Flash Attention is a hyperparameter determined by the GPU's SRAM size, and is typically set to the largest possible value that fits, such as 128 or 256.”