“Google's Inter-Chip Interconnect (ICI) technology can connect up to 8,000 TPU chips at high bandwidth in a switchless, direct-connect topology.”