SoylentNews is people
SoylentNews
Submission Preview
AI Workloads Spur Bigger Memory Drives
https://spectrum.ieee.org/huge-ssds [ieee.org]
At the SC24 supercomputing conference held in November in Atlanta, Hafþór Júlíus Björnsson (the actor who played The Mountain in Game of Thrones), deadlifted a custom barbell weighed down by 453 kilograms (1000 pounds) of solid state drives. The data stored in those drives totaled just over 280 petabytes.
“Without question, this is the most data lifted by a human in history,” says Andy Higginbotham, senior director of business development at Phison Electronics. High-performance data platform VDURA orchestrated the record-breaking lift in collaboration with Phison.
Behind this publicity stunt is a real trend—to feed AI’s insatiable data appetite, memory drives are getting larger, with no end in sight. Phison recently announced the largest SSD memory drive to date, storing 128 terabytes of data, and piled hundreds of them into Björnsson’s barbell. Within a few weeks, Solidigm announced its own 123 Tb drive. Samsung and Western Digital also recently started carrying similar products.
The shift towards more AI workloads in data centers has led to very power-hungry chips, mostly GPUs. Since the overall power use in a data center is going up, people are looking for ways to use less power wherever possible. At the same time, large language models and other AI models require ever increasing amounts of memory.
“You can see where storage requirements are going,” says Roger Corell, senior director of AI and leadership marketing at Solidigm. “You look at a large language model just a couple years ago, you had a half a petabyte per rack or lower. And now there’s large language models that pair with between three and three and a half petabytes per rack. Storage efficiency to enable continued scaling of AI infrastructure is really, really important.”
Crucially, this new crop of solid-state drives takes up the same area in a computing rackand power budget as their roughly 32 Tb and 64 Tb predecessors—although they are slightly taller—meaning they can be swapped into data centers for an easy win.
