“The ratio of FLOPs to memory bandwidth is a key hardware parameter that is approximately 300 for most modern GPUs.”