Everything that Nvidia and the market has learned about CPUs in the past decade can be brought to bear in Grace CPUs, and now Nvidia itself is big enough to be the primary contractor for exascale-class machines or at the very least supply the CPU and GPU compute as well as the networking and DPU offload engines to a supplier such as Hewlett Packard Enterprise, which really doesn't mind making custom variants of its "Shasta" EX supercomputers. And that is precisely what will be happening with the future "Alps" supercomputer going into the Swiss National Supercomputing Center [(CSCS)] in early 2023, featuring a hybrid compute module that has the homegrown Grace Arm server CPU very tightly couple with a future Nvidia GPU accelerator.
[...] CSCS is not alone in getting a Grace-Hopper supercomputer. Los Alamos National Laboratory, one of the Department of Energy national labs in the United States, will also be getting a Grace-Hopper system supercomputer system HPE in early 2023.
[...] Nvidia estimates that a Grace-Hopper system will offer 10X the performance on training natural language models, reducing it from one month to three days, and will allow for real-time inference on a 500 billion parameter model on a single node. And on the HPC front, computational fluid dynamics and weather applications are expected to see performance on the Grace-Hopper systems as well. Other HPC applications will no doubt follow.
« A SoylentNews Milestone | NASA Says its Mars Helicopter Made a Historic First Flight on Monday! [Updated] »
Arm pioneer Hermann Hauser has once again criticized Nvidia's plan to acquire the semiconductor design company, with The Telegraph reporting Sunday that he believes Nvidia is "clearly showing it will compete unfairly" if the deal is approved.
Hauser's concerns reportedly centered on the Grace processor Nvidia announced at GTC 2021. The company's first Arm-based CPU will connect to high-end GPUs via NVLink, which purportedly offers data transfer speeds up to 900 GBps. That's significantly faster than other technologies—it's also exclusively available to Nvidia.
This is why Hauser told The Telegraph that he believes using a proprietary interface like NVLink could end up "locking customers into [Nvidia] products," which "clearly shows that they will compete unfairly with other Arm-based server companies such as Amazon and Fujitsu," rather than retaining Arm's neutrality.
Nvidia-Branded ARM CPUs; UK Trade Union Speaks Out Against Deal
Nvidia's $40 Billion ARM Acquisition: "All but Dead"?
Nvidia Enters the Arms Race with Homegrown "Grace" CPUs
UK Will Investigate Nvidia's $40 Billion Arm Acquisition Attempt