Stories
Slash Boxes
Comments

SoylentNews is people

Submission Preview

Link to Story

Tesla Packs 50 Billion Transistors Onto D1 Dojo Chip Designed to Conquer Artificial Intelligence Tra

Accepted submission by upstart at 2021-08-22 01:12:55
News

upstart [soylentnews.org] writes:

████ # This file was generated bot-o-matically! Edit at your own risk. ████

Tesla Packs 50 Billion Transistors Onto D1 Dojo Chip Designed to Conquer Artificial Intelligence Training [tomshardware.com]:

Artificial intelligence (AI) has seen a broad adoption over the past couple of years. At Tesla, who as many know is a company that works on electric and autonomous vehicles, AI has a massive value to every aspect of the company's work. To speed up the AI software workloads, Tesla has today presented [cnbc.com] its D1 Dojo custom application-specific integrated circuit (ASIC) for AI training.

There are currently many companies building ASICs for AI workloads. Everyone from countless number of start-ups, all the way to big players like Amazon, Baidu, Intel and NVIDIA. However, not everyone gets the formula right and not everyone can satisfy each workload perfectly. That is the reason why Tesla opted to develop its own ASIC for AI training purposes.

Called the D1, the chip resembles a part of the Dojo supercomputer used to train AI models inside Tesla HQ, which are later deployed in various applications. The D1 chip is a product of TSMC's manufacturing efforts, forged in a 7nm semiconductor node. Packing over 50 billion transistors, the chip boasts a huge die size of 645mm^2.

The chip has some impressive performance claims, where Tesla states that it can output as much as 362 TeraFLOPs at FP16/CFP8 precision or about 22.6 TeraFLOPs of single-precision FP32 tasks. It is clear that Tesla optimized for FP16 data types, where they have managed to beat even the current leader in compute power - Nvidia. Nvidia's A100 Ampere GPU is capable of producing "only" 312 TeraFLOPs of power at FP16 workloads — and with sparsity, it can do up to double that.

Going to the silicon level, we see that Tesla built a mesh of functional units (FUs) that are interconnected together to form one massive chip. Each FU contains a 64-bit CPU with custom ISA, designed for transposes, gathers, broadcasts, and link traversals. The CPU design itself is a superscalar implementation with a 4-wide scalar and 2-wide vector pipelines. Looking at the images below, you can see that the FU is built with a big block for single instruction multiple data (SIMD) floating-point and integer processing elements. Each FU has its own 1.25MB scratchpad SRAM memory.

Image 1 of 6

Image 2 of 6

Image 3 of 6

Image 4 of 6

Image 5 of 6

Image 6 of 6

The FU itself is capable of performing one TeraFLOP of BF16 or CFP8, 64 GigaFLOPs of FP32 computation, and has 512 GB/s bandwidth in any direction in the mesh. The mesh is designed to traverse the FUs in only a single clock cycle, meaning that latencies are reduced and performance is increased. For more details, you can watch the Tesla AI day replay here [youtube.com].

Get instant access to breaking news, in-depth reviews and helpful tips.

Contact me with news and offers from other Future brands By submitting your information you agree to the Terms & Conditions [futureplc.com] and Privacy Policy [futureplc.com] and are aged 16 or over.MOST POPULARMOST SHARED

  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]
  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]

Tom's Hardware is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site [futureplc.com].

© Future US, Inc. 11 West 42nd Street, 15th Floor, New York, NY 10036.

Get instant access to breaking news, in-depth reviews and helpful tips.

Contact me with news and offers from other Future brands By submitting your information you agree to the Terms & Conditions [futureplc.com] and Privacy Policy [futureplc.com] and are aged 16 or over.MOST POPULARMOST SHARED

  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]
  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]

Tom's Hardware is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site [futureplc.com].

© Future US, Inc. 11 West 42nd Street, 15th Floor, New York, NY 10036.

Get instant access to breaking news, in-depth reviews and helpful tips.

Contact me with news and offers from other Future brands By submitting your information you agree to the Terms & Conditions [futureplc.com] and Privacy Policy [futureplc.com] and are aged 16 or over.MOST POPULARMOST SHARED

  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]
  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]

Tom's Hardware is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site [futureplc.com].

© Future US, Inc. 11 West 42nd Street, 15th Floor, New York, NY 10036.

Get instant access to breaking news, in-depth reviews and helpful tips.

Contact me with news and offers from other Future brands By submitting your information you agree to the Terms & Conditions [futureplc.com] and Privacy Policy [futureplc.com] and are aged 16 or over.MOST POPULARMOST SHARED

  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]
  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]

Tom's Hardware is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site [futureplc.com].

© Future US, Inc. 11 West 42nd Street, 15th Floor, New York, NY 10036.

Get instant access to breaking news, in-depth reviews and helpful tips.

Contact me with news and offers from other Future brands By submitting your information you agree to the Terms & Conditions [futureplc.com] and Privacy Policy [futureplc.com] and are aged 16 or over.MOST POPULARMOST SHARED

  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]
  1. 1This Intel-Based Mini PC Is Completely Fanless [tomshardware.com]
  2. 2America's Second Largest Mortgage Lender Plans to Accept Bitcoin [tomshardware.com]
  3. 3Powering a Raspberry Pi Zero With USB-C [tomshardware.com]
  4. 4Samsung Takes Intel's Throne as Top Semiconductor Manufacturer [tomshardware.com]
  5. 5AMD's Upcoming Socket AM5 for Raphael Processors to Lack PCIe 5.0 Support [tomshardware.com]

Tom's Hardware is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site [futureplc.com].

© Future US, Inc. 11 West 42nd Street, 15th Floor, New York, NY 10036.

Original Submission