In his 1990 undergraduate thesis, Jeff Dean implemented both model parallelism and data paralleli..., Sonic AI
“In his 1990 undergraduate thesis, Jeff Dean implemented both model parallelism and data parallelism for training neural networks on a 32-processor HyperCube machine.”