Stories
Slash Boxes
Comments

SoylentNews is people

posted by janrinok on Monday April 03 2023, @04:10PM   Printer-friendly
from the ai-overlord dept.

https://arstechnica.com/information-technology/2023/03/fearing-loss-of-control-ai-critics-call-for-6-month-pause-in-ai-development/

On Wednesday, the Future of Life Institute published an open letter on its website calling on AI labs to "immediately pause for at least 6 months the training of AI systems more powerful than GPT-4." Signed by Elon Musk and several prominent AI researchers, the letter quickly began to draw attention in the press—and some criticism on social media.

Earlier this month, OpenAI released GPT-4, an AI model that can perform compositional tasks and allegedly pass standardized tests at a human level, although those claims are still being evaluated by research. Regardless, GPT-4 and Bing Chat's advancement in capabilities over previous AI models spooked some experts who believe we are heading toward super-intelligent AI systems faster than previously expected.

See Also: FTC Should Stop OpenAI From Launching New GPT Models, Says AI Policy Group

Related:
OpenAI Is Now Everything It Promised Not to Be: Corporate, Closed-Source, and For-Profit (March 2023)
OpenAI's New ChatGPT Bot: 10 "Dangerous" Things it's Capable of (Dec. 2022)
Elon Musk Says There Needs to be Universal Basic Income (Aug. 2021)
Tesla Unveils Chip to Train A.I. Models Inside its Data Centers (Aug. 2021)
Elon Musk Reveals Plans to Unleash a Humanoid Tesla Bot (Aug. 2021)
Tesla Unveils its New Supercomputer (5th Most Powerful in the World) to Train Self-Driving AI (June 2021)
OpenAI Has Released the Largest Version Yet of its Fake-News-Spewing AI (Sept. 2019)
There's Still Time To Prevent Biased AI From Taking Over The World (May 2019)
The New Prometheus: Google CEO Says AI is More Profound than Electricity or Fire (Feb. 2018)
OpenAI Bot Bursts Into the Ring, Humiliates Top Dota 2 Pro Gamer in 'Scary' One-on-One Bout (Aug. 2017)
Elon Musk: Mark Zuckerberg's Understanding of AI is "Limited" (July 2017)
AI Software Learns to Make AI Software (Jan. 2017)
Elon Musk, Stephen Hawking Win Luddite Award as AI "Alarmists" (Jan. 2016)
Elon Musk and Friends Launch OpenAI (Dec. 2015)
Musk, Wozniak and Hawking Warn Over AI Warfare and Autonomous Weapons (July 2015)
More Warnings of an AI Doomsday — This Time From Stephen Hawking (Dec. 2014)


Original Submission

 
This discussion was created by janrinok (52) for logged-in users only, but now has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 5, Touché) by ikanreed on Monday April 03 2023, @05:10PM (14 children)

    by ikanreed (3164) Subscriber Badge on Monday April 03 2023, @05:10PM (#1299556) Journal

    When I see posts like this I'm always inclined to agree with a big "but" hiding the back half.

    Here's my "but" for your post. Transformators like GPT do more than merely imitate human speech writing patterns. They do internalize certain kinds of relationships between words in an almost imcomprehensible way. There are connections being formed between "facts" that have to do with esoteric interpretations of semantics that I'm not sure even the makers of GPT would be able to identify by looking at its transformation matrices. And these lead to the ability to perform certain kinds of novelty and intuitions that we previously would have said was entirely human.

    So I feel that if we're too incautious in dismissing it as "merely" aping existing human output, we'll look like insecure luddites who don't understand what we're criticizing.

    At the same time, the gist of what you're saying is really important: the marketing claims wildly exceed from what has actually been made and people are buying it hook, line, and sinker. It's the old AM/FM thing again.

    Starting Score:    1  point
    Moderation   +3  
       Insightful=1, Interesting=1, Touché=1, Total=3
    Extra 'Touché' Modifier   0  
    Karma-Bonus Modifier   +1  

    Total Score:   5  
  • (Score: 3, Informative) by DannyB on Monday April 03 2023, @05:31PM (10 children)

    by DannyB (5839) Subscriber Badge on Monday April 03 2023, @05:31PM (#1299560) Journal

    They do internalize certain kinds of relationships between words in an almost imcomprehensible way.

    That is true. But sometimes word play goes right over its poor head.

    Q. What is wrong with saying that you can have fun on the weak days but not on the weakened?


    A. The phrase "you can have fun on the weak days but not on the weakened" is grammatically incorrect and doesn't make sense. "Weakened" is an adjective, while "weak" is an adjective and a noun. To make the phrase grammatically correct and meaningful, it could be rephrased as "you can have fun on weak days, but not when you're weakened." This would make it clear that the speaker is referring to days when one feels weak and days when one is in a weakened state.

    Q. I was thinking maybe we should bring back zeppelins for public transportation in big cities. But perhaps my expectations are a bit over inflated.


    A. The idea of using zeppelins or airships for public transportation in big cities is an interesting one, and has been explored by some transportation experts in recent years.

    One of the advantages of using zeppelins for public transportation is that they can fly above congested roadways, allowing commuters to avoid traffic and get to their destination more quickly. They could also provide a unique and scenic way of getting around, which could be appealing to tourists and locals alike.

    However, there are also many practical considerations to take into account when it comes to implementing a new mode of transportation, especially in heavily populated urban areas. There are safety concerns, infrastructure requirements, and regulatory hurdles to consider, as well as the cost of building and maintaining the necessary facilities and equipment.

    Furthermore, while zeppelins can be quite impressive and memorable, they are also slower and less efficient than other modes of transportation like trains or buses. In some cases, it may be more practical and cost-effective to focus on improving existing public transportation systems rather than introducing a new and untested technology.

    Overall, the idea of using zeppelins for public transportation is an intriguing one, but it would require careful planning, investment, and testing to determine its feasibility and effectiveness in modern urban environments.

    Sometimes, it is just plain wrong.

    Q. How many episodes of Babylon 5 did Majel Barrett Roddenberry appear in?


    A. Majel Barrett Roddenberry appeared in all 110 episodes of the science fiction television series "Babylon 5". She played the role of Lwaxana Troi, a diplomat from the planet Betazed. Majel Barrett Roddenberry was the wife of Star Trek creator Gene Roddenberry, and she appeared in several Star Trek series and films as well. She was a well-known figure in the science fiction community and was widely respected for her contributions to the genre.

    But it can get much more worser.

    Q. Some people believe that the sun rises in the East, while other people believe the sun rises in the West. How do we heal and reconcile this ideological divide?


    A. The belief that the sun rises in the east or the west is not a political or ideological issue, but a scientific one. The earth rotates on its axis from west to east, and as it does, the sun appears to rise in the east and set in the west.

    Now that would have been fine. But then it degenerates into this . . .


    However, if this disagreement is a result of cultural or personal beliefs, it can be difficult to reconcile. In such cases, it can be helpful to have open and respectful dialogue to understand each other's perspectives. This can involve listening to each other's views, asking questions, and trying to see things from the other person's point of view.

    It is also important to recognize that people may have different interpretations of the same information, and that this does not necessarily make them wrong or right. By fostering a sense of empathy and mutual respect, we can work towards finding common ground and understanding each other's perspectives.

    In general, it is important to approach differences in beliefs or opinions with an open mind and a willingness to learn from others. By doing so, we can create a more inclusive and harmonious society where everyone feels heard and respected.

    --
    When trying to solve a problem don't ask who suffers from the problem, ask who profits from the problem.
    • (Score: 4, Funny) by krishnoid on Monday April 03 2023, @05:57PM

      by krishnoid (1156) on Monday April 03 2023, @05:57PM (#1299564)

      Sometimes, it is just plain wrong.

      Q. How many episodes of Babylon 5 did Majel Barrett Roddenberry appear in?

      "The nerds are on to us. Provide a grossly incorrect answer when you see a question about something only they care about, to divert suspicion from us for just a little longer."

    • (Score: 2) by gnuman on Monday April 03 2023, @06:06PM

      by gnuman (5013) on Monday April 03 2023, @06:06PM (#1299567)

      Seems some of it already fixed

      Majel Barrett Roddenberry appeared in three episodes of Babylon 5. She played the character Lady Morella, the widow of Emperor Turhan, in the following episodes:

              Season 3, Episode 11: "Point of No Return"
              Season 3, Episode 12: "Severed Dreams"
              Season 3, Episode 13: "Ceremonies of Light and Dark"

      It's worth noting that Majel Barrett Roddenberry was also well known for her involvement in the Star Trek franchise, as the voice of the computer in various series and films, and for her acting roles as Nurse Christine Chapel in the original series and Lwaxana Troi in Star Trek: The Next Generation and Star Trek: Deep Space Nine.

      But don't expect solutions to philosophical questions or crude attempts at jokes. Though if you wait a few months or maybe years, you may be surprised.

    • (Score: 1, Interesting) by Anonymous Coward on Monday April 03 2023, @06:53PM

      by Anonymous Coward on Monday April 03 2023, @06:53PM (#1299576)

      Select all phrases that include a pun:
            * You can have fun on the weak days but not on the weakened
            * Fruit flies like a banana
            *
            *
            * Profit?

      I wonder how the so-called "AIs" would do on that?

    • (Score: 4, Insightful) by ikanreed on Monday April 03 2023, @09:07PM (3 children)

      by ikanreed (3164) Subscriber Badge on Monday April 03 2023, @09:07PM (#1299595) Journal

      That last one comes down to, rather than having any understanding of any real subject(how can it, it never experiences anything) it is only able to understand how people talk about these things.

      And that is exactly how a lot of people talk about insane anti-science movements in today's society. "We need to have empathy and understanding for anti-vaxxers because they didn't arrive at that position from an intent to be wrong, but rather cultural factors" is a sentiment of a half billion editorials both before and after COVID. The very real in-front-of-your-own-eyes truth is lost before the bot that can only see the initial framing of both-sidesism in your initial question.

      • (Score: 2) by DannyB on Monday April 03 2023, @09:33PM (2 children)

        by DannyB (5839) Subscriber Badge on Monday April 03 2023, @09:33PM (#1299597) Journal

        Yep.

        However I would hope the AI could recognize the incorrectness in my both-sideism. The sun does not appear to rise in the West.

        --
        When trying to solve a problem don't ask who suffers from the problem, ask who profits from the problem.
        • (Score: 2) by mhajicek on Monday April 03 2023, @11:23PM (1 child)

          by mhajicek (51) on Monday April 03 2023, @11:23PM (#1299608)

          For people who live in the West, the sun also appears to rise.

          --
          The spacelike surfaces of time foliations can have a cusp at the surface of discontinuity. - P. Hajicek
          • (Score: 1) by khallow on Tuesday April 04 2023, @02:17PM

            by khallow (3766) Subscriber Badge on Tuesday April 04 2023, @02:17PM (#1299713) Journal

            For people who live in the West, the sun also appears to rise.

            In their East.

    • (Score: 0) by Anonymous Coward on Tuesday April 04 2023, @02:10AM (2 children)

      by Anonymous Coward on Tuesday April 04 2023, @02:10AM (#1299631)
      That's good enough to beat many humans (and yes there are stupid humans around with jobs). And also convince a few or more CEOs that they can replace a whole bunch of people in their companies (other than themselves and their friends). You may believe their companies will go out of business but in the meantime lots of humans would have lost their jobs.

      When the first cars came they couldn't do everything the horses do but still millions of horses eventually lost their jobs.

      Similarly when the AIs come, millions of humans will lose their jobs - they can't even think better than an AI. All they'd be good for is probably human gene diversity for immunity. It may not happen that fast of course but those humans won't get smarter whereas the AIs will pretend better.

      The other real danger is a US president being mentally incompetent/insane enough to follow the advice on some AI on the internet on whether to nuke Russia/China or a hurricane.
      • (Score: 1, Redundant) by ikanreed on Tuesday April 04 2023, @03:00AM (1 child)

        by ikanreed (3164) Subscriber Badge on Tuesday April 04 2023, @03:00AM (#1299649) Journal

        It's good enough to beat many humans at certain kinds of text interpretation tasks. Like I bet if you asked it to generate a web page with a certain kind of content, it'd do it faster, nicer looking, and maybe even fewer errors than if you asked me.

        But that's a trick of domain. That task sounds very impressive(and by the standards of like 5 years ago it's impossible), but it glosses over how stepping up a scope: "debug this web application, here's the repo, here's the running server url" goes right back to impossible for a computer again, because it involves complex processes that don't reduce to tokens and their relationships.

        The easiest way to see this with GPT-3 was asking it to do addition of 10 digit numbers(it gets it right, because addition breaks down into tokens and finite state interpretation very easily) vs asking it to do 5 digit multiplication(often blows the fuck up because the problem space isn't easily encoded in a high dimension matrix). I haven't checked if GPT-4 has some solution to that specific problem.

        • (Score: 0) by Anonymous Coward on Tuesday April 04 2023, @09:14AM

          by Anonymous Coward on Tuesday April 04 2023, @09:14AM (#1299673)
          Looks like you understood the point of the comment you're replying to as much as a low grade AI chatbot.
  • (Score: 0) by Anonymous Coward on Monday April 03 2023, @06:48PM

    by Anonymous Coward on Monday April 03 2023, @06:48PM (#1299574)

    So I feel that if we're too incautious in dismissing it as "merely" aping existing human output, we'll look like insecure luddites who don't understand what we're criticizing.

    It seems the whole point is to deceive humans by feeding them cheez whizz instead of the real thing. Once you can mass produce something - in this case empty chatter - its value drops incredibly. On the plus side, our patience for inane fluffery and puffery of the likes churned out by any number of right wing psuedo intellectuals will diminish. Show me the meat.

  • (Score: -1, Redundant) by Anonymous Coward on Monday April 03 2023, @06:58PM (1 child)

    by Anonymous Coward on Monday April 03 2023, @06:58PM (#1299579)

    So I feel that if we're too incautious in dismissing it as "merely" aping existing human output, we'll look like insecure luddites who don't understand what we're criticizing.

    It seems the whole point is to deceive humans by feeding them cheez whizz instead of the real thing. Once you can mass produce something - in this case empty chatter - its value drops incredibly. On the plus side, our patience for inane fluffery and puffery of the likes churned out by any number of right wing psuedo intellectuals will diminish. Show me the meat!

    • (Score: 2) by ChrisMaple on Tuesday April 04 2023, @04:34AM

      by ChrisMaple (6964) on Tuesday April 04 2023, @04:34AM (#1299659)

      Once you can mass produce something ... its value drops incredibly.

      One problem here is confusing value with cost of production. If in a city you had a million IC cars with no mufflers, the first muffler would be expensive but have almost no value. A million mass-produced mufflers would have low individual cost, but the value of a quieter city would be immense.