The five technical challenges Cerebras overcame in building the first trillion transistor chip
Superlatives abound at Cerebras, the until-today stealthy next-generation silicon chip company looking to make training a deep learning model as quick as buying toothpaste from Amazon. Launching after almost three years of quiet development, Cerebras introduced its new chip today — and it is a doozy. The "Wafer Scale Engine" is 1.2 trillion transistors (the most ever), 46,225 square millimeters (the largest ever), and includes 18 gigabytes of on-chip memory (the most of any chip on the market today) and 400,000 processing cores (guess the superlative).
It's made a big splash here at Stanford University at the Hot Chips conference, one of the silicon industry's big confabs for product introductions and roadmaps, with various levels of oohs and aahs among attendees. You can read more about the chip from Tiernan Ray at Fortune and read the white paper from Cerebras itself.
Also at BBC, VentureBeat, and PCWorld.
(Score: 2) by takyon on Tuesday August 20 2019, @09:27PM (1 child)
https://cdn.wccftech.com/wp-content/uploads/2019/08/cerebras-wse-nvidia-v100-featured-image.jpg [wccftech.com]
I skimmed the white paper [cerebras.net] and there's nothing to answer your specific questions. But there's one bad typo:
I think that's supposed to be 9.6 petabytes per second.
The TechCrunch article does get into packaging:
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
(Score: 2) by All Your Lawn Are Belong To Us on Tuesday August 20 2019, @10:26PM
I'd hate to hold a laptop with a chip like this in my lap.... :O ;)
This sig for rent.