Stories
Slash Boxes
Comments

SoylentNews is people

posted by takyon on Thursday May 07 2015, @07:01PM   Printer-friendly
from the neuromorphic-computing-strikes-again dept.

A new way of creating a neural network using specially formulated memristors has been described by a team of researchers from Stony Brook University and the University of California Santa Barbara. The process has the potential to place an entire neural network on a single chip:

The system produced by the authors here involved only a 12-by-12 grid of memristors, so it's pretty limited in capacity. But Robert Legenstein, from Austria's Graz University of Technology, writes in an accompanying perspective that "If this design can be scaled up to large network sizes, it will affect the future of computing."

That's because there are still many challenges where a neural network can easily outperform traditional computing hardware—and do so at a fraction of the energy cost. Even on a 30 nm process, it would be possible to place 25 million cells in a square centimeter, with 10,000 synapses on each cell. And all that would dissipate about a Watt.

Training and operation of an integrated neuromorphic network based on metal-oxide memristors [abstract]

MIT Technology Review

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 2) by kaszz on Thursday May 07 2015, @10:56PM

    by kaszz (4211) on Thursday May 07 2015, @10:56PM (#180092) Journal

    So we only need 10^10 chips to replicate the human brain [willamette.edu]. And 10 GW to power it all. I suspect however that neural chips won't have to be perfect like ordinary digital chips.

    Dude, got nuclear plant? ;)

    (would need like 20 of them..)

    Starting Score:    1  point
    Karma-Bonus Modifier   +1  

    Total Score:   2  
  • (Score: 4, Informative) by martyb on Friday May 08 2015, @01:34AM

    by martyb (76) Subscriber Badge on Friday May 08 2015, @01:34AM (#180141) Journal

    Might want to check your math there...

    So we only need 10^10 chips to replicate the human brain [willamette.edu]. And 10 GW to power it all. I suspect however that neural chips won't have to be perfect like ordinary digital chips.

    Dude, got nuclear plant? ;)

    (would need like 20 of them..)

    And from the link you provided it states that there are about 10^10 neurons and 10^14 synapses in a human brain.

    The story summary states:

    Even on a 30 nm process, it would be possible to place 25 million cells in a square centimeter, with 10,000 synapses on each cell.

    According to my calculations, that implies that each square centimeter would contain:

    25x10^6 * 10^4 = 25x10^10 synapses.

    which implies it would take about 400 cm^2 to replicate the number of synapses in a human brain. At 1 watt dissipated for each cm^2, one might need a bit less than a nuclear power plant to run the thing. And, that was on a conservative 30 nm process; we're at something like a 14 nm process now. A crude calculation suggests that 4 times as many synapses would fit on a single chip. Without assuming any improvement in performance per watt, we are now down to needing only 100 cm^2 and a requirement of less than 100 watts to run it. Which is within an order of magnitude of the stated 30 W of power needed by the human brain in your linked article.

    PS It's late and I'm tired, so there may well be an error in my calculations; I'd appreciate it if someone would verify my math.

    --
    Wit is intellect, dancing.
  • (Score: 2) by threedigits on Friday May 08 2015, @08:00AM

    by threedigits (607) on Friday May 08 2015, @08:00AM (#180234)

    From the article, this prototype has 30 synapses. This means we would need 250 to simulate a C. Elegans neural network (7.500 synapses), 3 millions to simulate an ant (10^8 synapses), and
    3 * 10^12 (3 hundred billions) for a human brain (10^14 synapses).

    The speculated chip (not the one they actually built) would include 25 million cells, each with 10,000 synapses, for a total of 2.5 * 10^11 synapses, which is enough to simulate an small army of 1000 ants (if I get those numbers right). For a human brain you would still need 1,000 of them, so it will take an small room and a kW of power. But in 40-50 years our kids will be using one to keep the time in their watches.