SoylentNews
SoylentNews is people
https://soylentnews.org/

Title    Supercomputers with Non-Von Neumann Architectures Could Reach "Zettascale" and "Yottascale"
Date    Wednesday July 11 2018, @06:14PM
Author    martyb
Topic   
from the where-many-flops-is-a-GOOD-thing dept.
https://soylentnews.org/article.pl?sid=18/07/11/147223

takyon writes:

In an interview posted just before the release of the latest TOP500 list, high performance computing expert Dr. Thomas Sterling (one of the two builders of the original "Beowulf cluster") had this to say about the possibility of reaching "zettascale" (beyond 1,000 exaflops):

I'll close here by mentioning two other possibilities that, while not widely considered currently, are nonetheless worthy of research. The first is superconducting supercomputing and the second is non-von Neumann architectures. Interestingly, the two at least in some forms can serve each other making both viable and highly competitive with respect to future post-exascale computing designs. Niobium Josephson Junction-based technologies cooled to four Kelvins can operate beyond 100 and 200 GHz and has slowly evolved over two or more decades. When once such cold temperatures were considered a show stopper, now quantum computing – or at least quantum annealing – typically is performed at 40 milli-Kelvins or lower, where four Kelvins would appear like a balmy day on the beach. But latencies measured in cycles grow proportionally with clock rate and superconducting supercomputing must take a very distinct form from typical von Neumann cores; this is a controversial view, by the way.

Possible alternative non-von Neumann architectures that would address this challenge are cellular automata and data flow, both with their own problems, of course – nothing is easy. I introduce this thought not to necessarily advocate for a pet project – it is a pet project of mine – but to suggest that the view of the future possibilities as we enter the post-exascale era is a wide and exciting field at a time where we may cross a singularity before relaxing once again on a path of incremental optimizations.

I once said in public and in writing that I predicted we would never get to zettaflops computing. Here, I retract this prediction and contribute a contradicting assertion: zettaflops can be achieved in less than 10 years if we adopt innovations in non-von Neumann architecture. With a change to cryogenic technologies, we can reach yottaflops by 2030.

The rest of the interview covers a number of interesting topics, such as China's increased presence on the supercomputing list.

Also at NextBigFuture.

Previously: Thomas Sterling: 'I Think We Will Never Reach Zettaflops' (2012)

Related: IBM Reduces Neural Network Energy Consumption Using Analog Memory and Non-Von Neumann Architecture
IEEE Releases the International Roadmap for Devices and Systems (IRDS)
June 2018 TOP500 List: U.S. Claims #1 and #3 Spots


Original Submission

Links

  1. "takyon" - https://soylentnews.org/~takyon/
  2. "TOP500" - https://www.top500.org/
  3. "Dr. Thomas Sterling" - https://en.wikipedia.org/wiki/Thomas_Sterling_(computing)
  4. "had this to say" - https://www.top500.org/news/thomas-sterling-talks-exascale-chinese-hpc-machine-learning-and-non-von-neumann-architectures/
  5. ""zettascale"" - https://en.wikipedia.org/wiki/Computer_performance_by_orders_of_magnitude#Zettascale_computing_(1021)
  6. "NextBigFuture" - https://www.nextbigfuture.com/2018/07/non-von-neumann-zettaflops-supercomputers-yottaflops-cryogenic-supercomputers-and-beyond-with-molecular-nanotechnology.html
  7. "Thomas Sterling: 'I Think We Will Never Reach Zettaflops'" - https://www.hpcwire.com/2012/05/07/thomas_sterling_i_think_we_will_never_reach_zettaflops_/
  8. "IBM Reduces Neural Network Energy Consumption Using Analog Memory and Non-Von Neumann Architecture" - https://soylentnews.org/article.pl?sid=18/06/20/226213
  9. "IEEE Releases the International Roadmap for Devices and Systems (IRDS)" - https://soylentnews.org/article.pl?sid=18/06/20/229233
  10. "June 2018 TOP500 List: U.S. Claims #1 and #3 Spots" - https://soylentnews.org/article.pl?sid=18/06/25/1832258
  11. "Original Submission" - https://soylentnews.org/submit.pl?op=viewsub&subid=27808

© Copyright 2024 - SoylentNews, All Rights Reserved

printed from SoylentNews, Supercomputers with Non-Von Neumann Architectures Could Reach "Zettascale" and "Yottascale" on 2024-04-19 03:29:00