SoylentNews is people
SoylentNews
Elon Musk was recently interviewed at an MIT Symposium. An audience asked his views on artificial intelligence (AI). Musk turned very serious, and urged extreme caution and national or international regulation to avoid "doing something stupid" he said.
"With artificial intelligence we are summoning the demon", said Musk. "In all those stories where there's the guy with the pentagram and the holy water, it's like, 'Yeah, he's sure he can control the demon.' Doesn't work out."
Read the story and see the full interview here.
This discussion has been archived.
No new comments can be posted.
Elon Musk: "We are Summoning the Demon"
|
Log In/Create an Account
| Top
| 94 comments
| Search Discussion
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Everything is worth precisely as much as a belch, the difference being
that a belch is more satisfying.
-- Ingmar Bergman
(Score: 2) by HiThere on Monday October 27 2014, @06:08PM
Yes. The problem with the demon analogy lies in the assumption of a human goal structure. If you *do* design a human goal structure into an AI, then the fear is justified, but why would you do that? No human (few humans?) wants to be enslaved. Dogs don't mind. (OTOH, don't model a dog either, because dogs do desire to be pack leader.)
The problem isn't the intelligence of the AI, the intelligence is merely the enabler of the problem. The real problem is that there are several already identified corner cases where seemingly reasonable goal structures can lead to disaster. To use a classical example "Yes, master. I will attempt to turn the entire universe into paper-clips." So you need a goal structure that is robust against corner cases as well as not being actively malicious.
Javascript is what you use to allow unknown third parties to run software you have no idea about on your computer.