SoylentNews is people
SoylentNews
from the what-is-that-in-Libraries-of-Congress? dept.
"Frontiersman" Cray Snags $50m Storage Contract for 'Largest Single Filesystem':
Cray has won a $50m-plus contract to provide 1 exabyte of ClusterStor storage for Oak Ridge National Laboratory's (ORNL) Frontier exascale supercomputer in the United States.
Frontier is a $600m-plus Cray-AMD exascale system, rated at up to 1.5 exaFLOPS, due to be delivered in 2021 with acceptance in 2022. It will be a follow-on to ORNL's 200 petaFLOPS Summit supercomputer.
Cray won the Frontier bid with its Shasta supercomputer, powered by AMD EPYC processors and Radeon Instinct GPUs in May, so the associated storage contract is not unexpected.
[...] It will have 1 exabyte of ClusterStor hybrid flash and disk storage in 40 cabinets with a direct Slingshot connection to the compute nodes. The ClusterStor nodes will run the Lustre parallel file system with ZFS local volumes all in POSIX-compliant global namespace. The system will output 10TB/sec, four times that of Summit's 2.5TB/sec Spectrum Scale storage.
Cray claimed it will be the largest single filesystem in the world. The flash will be used for high-speed scratch space with the disk being the capacity store. Files will be tiered between the two types of storage and the system is designed to cope with random, small file access and large file streaming. There will be a new software stack for tiering and improved manageability. It will help scaling across both compute and storage.
Let's see here. Kilo, mega, giga, tera, peta, exa, ... How far we have come! My first personal computer had 4 KB of memory and stored programs to cassette tape. These days, most cell phones have at least 8 or 16 GB of storage, often 32 or 64 GB, and one can even buy 1 TB microSD cards. That is not even close to what is mentioned in this announcement. You would need 1,000,000 of these 1 TB cards to provide the storage announced here.
(Score: 2) by stretch611 on Wednesday June 19 2019, @08:25AM (7 children)
How much pr0n will that hold? (After all, that does a lot more to let people understand how much capacity a drive has instead of 1,000,000 - 1TB cards.)
Now with 5 covid vaccine shots/boosters altering my DNA :P
(Score: 0, Disagree) by Anonymous Coward on Wednesday June 19 2019, @08:39AM (1 child)
Nobody stores their porn locally anymore.
(Score: 2) by takyon on Wednesday June 19 2019, @09:12AM
We're sorry, this video has been deleted by a Special Representative of the United Nations for promoting unrealistic expectations of the female body as well as heteronormative behavior. Here are some recommendations for inclusive and body-positive pornography: [thumbnails redacted]
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
(Score: 2) by krishnoid on Wednesday June 19 2019, @08:56AM (1 child)
Enough that you'll have to download the files directly to your brain and have your visual cortex read the compressed files at wire speed, to go through all of it within your lifetime.
(Score: 2) by takyon on Wednesday June 19 2019, @09:03AM
Download it all, then use masheen learning to tap your brain implant and locate the content you want after filtering out 99.9999% of it.
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
(Score: 2) by takyon on Wednesday June 19 2019, @09:02AM
https://soylentnews.org/comments.pl?noupdate=1&sid=26740&page=1&cid=711214#commentwrap [soylentnews.org]
https://soylentnews.org/comments.pl?noupdate=1&sid=27015&page=1&cid=719168#commentwrap [soylentnews.org]
Porn storage requirements don't seem that high to start out. Maybe as low as 100 TB for a site with low resolution video. That can easily escalate to petabytes for storing otherwise ephemeral cammer streams. If quality shot up, especially for the purpose of VR video, then you might be able to blow past 10-100 petabytes.
Basically, if you can find out that $popular_pr0n_site = 500 terabytes (currently), then you can use it as the new "Library of Congresses" unit. It could go up orders of magnitude if VR becomes popular.
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
(Score: 2) by Freeman on Wednesday June 19 2019, @04:41PM (1 child)
The correct answer is, all of it.
Hmm..., possibly not all of it, but definitely enough that you wouldn't be able to view it all.
Joshua 1:9 "Be strong and of a good courage; be not afraid, neither be thou dismayed: for the Lord thy God is with thee"
(Score: 2) by bob_super on Wednesday June 19 2019, @09:13PM
Porn is as infinite as natural numbers, according to Rule 34.
For if there was to be a stash of all the porn, then there would be more porn, about the porn in that stash of all the porn.
(Score: 4, Interesting) by takyon on Wednesday June 19 2019, @09:25AM (1 child)
It says the bulk of it is on hard disks. 1 exabyte is 62,500 16 TB hard drives.
NAND has the density advantage now (imagine a bucket filled with 1 TB microSD cards), but nobody here trusts it given the endurance and retention downgrades. Though the same increase in layers to 128 and beyond helps SLC wherever that is still used.
We need a new technology that is re-writable, has unpowered data retention, and is at least as fast and dense as NAND (using 3D stacking), but with much greater endurance. Eventually, home users should be able to obtain exabytes of whatever this post-NAND storage turns out to be (memristors, RRAM, holographic crystals, etc.).
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
(Score: 2) by Freeman on Wednesday June 19 2019, @04:45PM
Superman storage crystals, here we come!
Joshua 1:9 "Be strong and of a good courage; be not afraid, neither be thou dismayed: for the Lord thy God is with thee"
(Score: 0) by Anonymous Coward on Wednesday June 19 2019, @08:18PM (1 child)
This should have been the supplier:
https://en.wikipedia.org/wiki/Exabyte_(company) [wikipedia.org]
(Score: 2) by takyon on Wednesday June 19 2019, @08:56PM
I hope we see LTO tapes [wikipedia.org] reach 1 exabyte each.
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]