Stories
Slash Boxes
Comments

SoylentNews is people

OpenAI’s New Language Generator GPT-3 is Shockingly Good

posted by martyb on Friday August 14 2020, @10:01AM   Printer-friendly
from the Voiced-by-Majel-Barrett-Roddenberry? dept.

upstart writes in with an IRC submission:

OpenAI's new language generator GPT-3 is shockingly good (archive):

GPT-3 is the most powerful language model ever. Its predecessor, GPT-2, released last year, was already able to spit out convincing streams of text in a range of different styles when prompted with an opening sentence. But GPT-3 is a big leap forward. The model has 175 billion parameters (the values that a neural network tries to optimize during training), compared with GPT-2's already vast 1.5 billion. And with language models, size really does matter.

Sabeti linked to a blog post where he showed off short stories, songs, press releases, technical manuals, and more that he had used the AI to generate. GPT-3 can also produce pastiches of particular writers. Mario Klingemann, an artist who works with machine learning, shared a short story called "The importance of being on Twitter," written in the style of Jerome K. Jerome, which starts: "It is a curious fact that the last remaining form of social life in which the people of London are still interested is Twitter. I was struck with this curious fact when I went on one of my periodical holidays to the sea-side, and found the whole place twittering like a starling-cage." Klingemann says all he gave the AI was the title, the author's name and the initial "It." There is even a reasonably informative article about GPT-3 written entirely by GPT-3.

[...] Others have found that GPT-3 can generate any kind of text, including guitar tabs or computer code. For example, by tweaking GPT-3 so that it produced HTML rather than natural language, web developer Sharif Shameem showed that he could make it create web-page layouts by giving it prompts like "a button that looks like a watermelon" or "large text in red that says WELCOME TO MY NEWSLETTER and a blue button that says Subscribe." Even legendary coder John Carmack, who pioneered 3D computer graphics in early video games like Doom and is now consulting CTO at Oculus VR, was unnerved: "The recent, almost accidental, discovery that GPT-3 can sort of write code does generate a slight shiver."

[...] Yet despite its new tricks, GPT-3 is still prone to spewing hateful sexist and racist language. Fine-tuning the model helped limit this kind of output in GPT-2.

Original Submission

 
This discussion has been archived. No new comments can be posted.
OpenAI’s New Language Generator GPT-3 is Shockingly Good | Log In/Create an Account | Top | 59 comments | Search Discussion
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.

  • (Score: 3, Interesting) by takyon on Friday August 14 2020, @10:26AM (8 children)

    by takyon (881) <takyonNO@SPAMsoylentnews.org> on Friday August 14 2020, @10:26AM (#1036492) Journal

    OpenAI first described GPT-3 in a research paper published in May. But last week it began drip-feeding the software to selected people who requested access to a private beta. For now, OpenAI wants outside developers to help it explore what GPT-3 can do, but it plans to turn the tool into a commercial product later this year, offering businesses a paid-for subscription to the AI via the cloud.

    It's all about control with "OpenAI".

    --
    [SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
    Starting Score:    1  point
    Moderation   +1  
       Interesting=1, Total=1
    Extra 'Interesting' Modifier   0  
    Karma-Bonus Modifier   +1  
    Total Score:   3  

  • (Score: 4, Insightful) by maxwell demon on Friday August 14 2020, @10:40AM (7 children)

    by maxwell demon (1608) on Friday August 14 2020, @10:40AM (#1036493) Journal

    If they don't want to make it open, maybe they should rename themselves from “OpenAI” to “ClosedAI”.

    --
    The Tao of math: The numbers you can count are not the real numbers.

    • (Score: 2) by DannyB on Friday August 14 2020, @02:48PM (3 children)

      by DannyB (5839) Subscriber Badge on Friday August 14 2020, @02:48PM (#1036545) Journal

      Just imagine if every open source technology that could be used for harm were not published.

      For example: Metasploit. Kali Linux. DOT Net Core. Systemd.


      Mom: What language do they speak in the UK?
      Son: I'm at work mom, just Google it.
      Mom: I'll just wait 'till you get home. I don't want to bother Google people with that. I'm sure they have more important questions to answer.

      --
      To transfer files: right-click on file, pick Copy. Unplug mouse, plug mouse into other computer. Right-click, paste.

    • (Score: 0) by Anonymous Coward on Friday August 14 2020, @04:03PM (1 child)

      by Anonymous Coward on Friday August 14 2020, @04:03PM (#1036582)

      Perhaps they should ask it to name itself.

      If it calls itself 'Colosson', show it a chicken picture immediately and report David Mitchell to the UK authorities for being a Cylon.

      • (Score: 0) by Anonymous Coward on Friday August 14 2020, @04:22PM

        by Anonymous Coward on Friday August 14 2020, @04:22PM (#1036591)

        Parent post AC here. My browser lied, sorry for the double post.

    • (Score: 0) by Anonymous Coward on Friday August 14 2020, @04:18PM

      by Anonymous Coward on Friday August 14 2020, @04:18PM (#1036589)

      If they don't want to make it open, maybe they should rename themselves from “OpenAI” to “ClosedAI”.

      Perhaps they should ask it to name itself.

      If it calls itself "Colosson", they should show it a chicken picture and cut UK funnyman David Mitchell a royalty check.

      That's what I call 'Numberwang'.