Google has assembled thousands of Tensor Processor Units (TPUs) into giant programmable supercomputers and made them available on Google Cloud
[...] To be precise, Google has used a "two-dimensional toroidal" mesh network to enable multiple racks of TPUs to be programmable as one colossal AI supercomputer. The company says more than 1,000 TPU chips can be connected by the network.
Google claims each TPU v3 pod can deliver more than 100 petaFLOPS of computing power, which puts them amongst the world's top five supercomputers in terms of raw mathematical operations per second. Google added the caveat, however, that the pods operate at a lower numerical precision, making them more appropriate for superfast speech recognition or image classification – workloads that do not need high levels of precision.
(Score: 2) by bob_super on Wednesday May 08 2019, @07:25PM (7 children)
> Google has used a "two-dimensional toroidal" mesh network
Can someone explain to me a two-dimensional toroidal anything ?
Call marketing, and tell them to review the bullshitometer readings, and upgrade the press release to Tetradimensional Toroidal, please.
Cause less than 3 ain't gonna cut it.
(Score: 3, Informative) by mhajicek on Wednesday May 08 2019, @09:26PM (1 child)
It's a ring network.
The spacelike surfaces of time foliations can have a cusp at the surface of discontinuity. - P. Hajicek
(Score: 0) by Anonymous Coward on Wednesday May 08 2019, @11:37PM
It's a ring of ring networks because a 3d torus is made of a 2d toroidal mesh
(Score: 2) by c0lo on Wednesday May 08 2019, @11:57PM (4 children)
Take a 2D grid with the 'travelling' rule of "whenever you reach the border along any one dimension, you wrap around that dimension". This make your grid adopt a toroid topology.
https://www.youtube.com/watch?v=aoFiw2jMy-0 https://soylentnews.org/~MichaelDavidCrawford
(Score: 2) by bob_super on Thursday May 09 2019, @12:12AM (3 children)
I know. But if it's 2D, then it's a Pac-Man topology.
Toroids are 3D objects.
(Score: 2) by c0lo on Thursday May 09 2019, @12:51AM (1 child)
Topology doesn't care as long as you preserve the navigational - in this case, connectivity/networking - properties.
The RAM in your computer is 3D too, yet you are addressing it as 1D.
https://www.youtube.com/watch?v=aoFiw2jMy-0 https://soylentnews.org/~MichaelDavidCrawford
(Score: 2) by bob_super on Thursday May 09 2019, @12:56AM
Hey ! Work with me here !
I wanna see the faces of CEOs when they have to deliver the presentation to the press, and their schmancy multi-million dollar supermachines run a Pac-Man topology.
(Score: 0) by Anonymous Coward on Thursday May 09 2019, @08:10AM
The surface of a torus is 2D.