Stories
Slash Boxes
Comments

SoylentNews is people

SoylentNews is powered by your submissions, so send in your scoop. Only 17 submissions in the queue.

Samsung Announces HBM2 Memory With Integrated AI Processor

posted by martyb on Thursday February 18 2021, @12:40AM   Printer-friendly
from the smarter-memory dept.

takyon writes:

Samsung's New HBM2 Memory Thinks for Itself: 1.2 TFLOPS of Embedded Processing Power

Today, Samsung announced that its new HBM2-based memory has an integrated AI processor that can push out (up to) 1.2 TFLOPS of embedded computing power, allowing the memory chip itself to perform operations that are usually reserved for CPUs, GPUs, ASICs, or FPGAs.

The new HBM-PIM (processing-in-memory) chips inject an AI engine inside each memory bank, thus offloading processing operations to the HBM itself. The new class of memory is designed to alleviate the burden of moving data between memory and processors, which is often more expensive in terms of power consumption and time than the actual compute operations.

[...] As with most in-memory processing techniques, we expect this tech will press the boundaries of the memory chips' cooling limitations, especially given that HBM chips are typically deployed in stacks that aren't exactly conducive to easy cooling. Samsung's presentation did not cover how HBM-PIM addresses those challenges.

HBM: High Bandwidth Memory.
ASIC: Application-Specific Integrated Circuit.
FPGA: Field-Programmable Gate Array.

Original Submission

 
This discussion has been archived. No new comments can be posted.
Samsung Announces HBM2 Memory With Integrated AI Processor | Log In/Create an Account | Top | 20 comments | Search Discussion
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.

  • (Score: 1, Insightful) by Anonymous Coward on Thursday February 18 2021, @01:38AM (1 child)

    by Anonymous Coward on Thursday February 18 2021, @01:38AM (#1114267)

    When I was a kid, a Tektronix salesman got us a 24bpps "loaner". We had a 300bps acoustic modem to the Perkin-Elmer at the company.

    300bps * ATT phone charges meant I only got so much time playing on the "big" computer.

    Figured out how to half-way do space-invaders on the local Tektronix "monitor".

    ---

    Served me well the rest of my career. "Its the mainframe" ... "Its the LAN" ... "Its the Internet" ... "Its the Browser" ... "Its the Cloud" ... "Its the RAM" ...

    Cycle is centralize/decentralize ... once you know what's hip, you know what jobs to look for if you want to catch the next wave.

    Starting Score:    0  points
    Moderation   +1  
       Insightful=1, Total=1
    Extra 'Insightful' Modifier   0  
    Total Score:   1  

  • (Score: 2) by Muad'Dave on Thursday February 18 2021, @12:50PM

    by Muad'Dave (1413) on Thursday February 18 2021, @12:50PM (#1114427)

    ... the Perkin-Elmer at the company.

    Too cool! My first job out of college was working for Concurrent Computer, which was PE's computing division. Do you remember what model you used?

    I still remember OS/32 commands and Assembler instructions.