“The introduction of Tensor Cores in NVIDIA's Volta architecture was motivated by the need to solve the high data movement cost from register files, which constituted approximately 7/8ths of the circuit cost.”