A new way of creating a neural network using specially formulated memristors has been described by a team of researchers from Stony Brook University and the University of California Santa Barbara. The process has the potential to place an entire neural network on a single chip:
The system produced by the authors here involved only a 12-by-12 grid of memristors, so it's pretty limited in capacity. But Robert Legenstein, from Austria's Graz University of Technology, writes in an accompanying perspective that "If this design can be scaled up to large network sizes, it will affect the future of computing."
That's because there are still many challenges where a neural network can easily outperform traditional computing hardware—and do so at a fraction of the energy cost. Even on a 30 nm process, it would be possible to place 25 million cells in a square centimeter, with 10,000 synapses on each cell. And all that would dissipate about a Watt.
Training and operation of an integrated neuromorphic network based on metal-oxide memristors [abstract]
(Score: 2) by kaszz on Thursday May 07 2015, @10:56PM
So we only need 10^10 chips to replicate the human brain [willamette.edu]. And 10 GW to power it all. I suspect however that neural chips won't have to be perfect like ordinary digital chips.
Dude, got nuclear plant? ;)
(would need like 20 of them..)
(Score: 4, Informative) by martyb on Friday May 08 2015, @01:34AM
Might want to check your math there...
And from the link you provided it states that there are about 10^10 neurons and 10^14 synapses in a human brain.
The story summary states:
According to my calculations, that implies that each square centimeter would contain:
which implies it would take about 400 cm^2 to replicate the number of synapses in a human brain. At 1 watt dissipated for each cm^2, one might need a bit less than a nuclear power plant to run the thing. And, that was on a conservative 30 nm process; we're at something like a 14 nm process now. A crude calculation suggests that 4 times as many synapses would fit on a single chip. Without assuming any improvement in performance per watt, we are now down to needing only 100 cm^2 and a requirement of less than 100 watts to run it. Which is within an order of magnitude of the stated 30 W of power needed by the human brain in your linked article.
PS It's late and I'm tired, so there may well be an error in my calculations; I'd appreciate it if someone would verify my math.
Wit is intellect, dancing.
(Score: 2) by threedigits on Friday May 08 2015, @08:00AM
From the article, this prototype has 30 synapses. This means we would need 250 to simulate a C. Elegans neural network (7.500 synapses), 3 millions to simulate an ant (10^8 synapses), and
3 * 10^12 (3 hundred billions) for a human brain (10^14 synapses).
The speculated chip (not the one they actually built) would include 25 million cells, each with 10,000 synapses, for a total of 2.5 * 10^11 synapses, which is enough to simulate an small army of 1000 ants (if I get those numbers right). For a human brain you would still need 1,000 of them, so it will take an small room and a kW of power. But in 40-50 years our kids will be using one to keep the time in their watches.