Stories
Slash Boxes
Comments

SoylentNews is people

posted by martyb on Tuesday March 30 2021, @01:30PM   Printer-friendly [Skip to comment(s)]

OpenAI's Text-Generating System Gpt-3 Is Now Spewing Out 4.5 Billion Words A Day:

The best-known AI text-generator is OpenAI's GPT-3, which the company recently announced is now being used in more than 300 different apps, by "tens of thousands" of developers, and producing 4.5 billion words per day. That's a lot of robot verbiage. This may be an arbitrary milestone for OpenAI to celebrate, but it's also a useful indicator of the growing scale, impact, and commercial potential of AI text generation.

OpenAI started life as a nonprofit, but for the last few years, it has been trying to make money with GPT-3 as its first salable product. The company has an exclusivity deal with Microsoft which gives the tech giant unique access to the program's underlying code, but any firm can apply for access to GPT-3's general API and build services on top of it.

[...] All this is good news for OpenAI (and Microsoft, whose Azure cloud computing platform powers OpenAI's tech), but not everyone in startup-land is keen.

[...] Like many algorithms, text generators have the capacity to absorb and amplify harmful biases. They're also often astoundingly dumb. In tests of a medical chatbot built using GPT-3, the model responded to a "suicidal" patient by encouraging them to kill themselves. These problems aren't insurmountable, but they're certainly worth flagging in a world where algorithms are already creating mistaken arrests, unfair school grades, and biased medical bills.


Original Submission

Related Stories

Microsoft and Nvidia Create 105-Layer, 530 Billion Parameter Language Model That Needs 280 A100 GPUs 19 comments

Microsoft and Nvidia create 105-layer, 530 billion parameter language model that needs 280 A100 GPUs, but it's still biased

Nvidia and Microsoft have teamed up to create the Megatron-Turing Natural Language Generation model, which the duo claims is the "most powerful monolithic transformer language model trained to date".

The AI model has 105 layers, 530 billion parameters, and operates on chunky supercomputer hardware like Selene. By comparison, the vaunted GPT-3 has 175 billion parameters.

"Each model replica spans 280 NVIDIA A100 GPUs, with 8-way tensor-slicing within a node, and 35-way pipeline parallelism across nodes," the pair said in a blog post.

[...] However, the need to operate with languages and samples from the real world meant an old problem with AI reappeared: Bias. "While giant language models are advancing the state of the art on language generation, they also suffer from issues such as bias and toxicity," the duo said.

Related: OpenAI's New Language Generator GPT-3 is Shockingly Good
A College Student Used GPT-3 to Write a Fake Blog Post that Ended Up at the Top of Hacker News
A Robot Wrote This Entire Article. Are You Scared Yet, Human?
OpenAI's Text-Generating System GPT-3 Is Now Spewing Out 4.5 Billion Words a Day


Original Submission

This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
(1)
  • (Score: 0) by Anonymous Coward on Tuesday March 30 2021, @01:54PM

    by Anonymous Coward on Tuesday March 30 2021, @01:54PM (#1131190)

    I doubt it runs 24/7/365... I think this is more of a "it can produce things at such a rate that adds up to 4.5 billion words per day"

    That being said, it's still all gibberish and equivalent to your usual post-modernist paper.

  • (Score: 1, Insightful) by Anonymous Coward on Tuesday March 30 2021, @02:08PM (2 children)

    by Anonymous Coward on Tuesday March 30 2021, @02:08PM (#1131198)

    What's not to like?

    • (Score: 4, Touché) by DannyB on Tuesday March 30 2021, @05:07PM

      by DannyB (5839) Subscriber Badge on Tuesday March 30 2021, @05:07PM (#1131279) Journal

      Think of the applications:

      • Advertising copy
      • Live on-air teleprompter copy for news anchors
      • Auto generated legislation or amendments to bills

      What we really need is an AI that can generate PowerPoint slides with pictures for managers to present.

      --
      Employers should not mandate wearing clothing. It should be a personal choice. It only affects me. Junk can't breathe!
    • (Score: 1, Interesting) by Anonymous Coward on Tuesday March 30 2021, @10:00PM

      by Anonymous Coward on Tuesday March 30 2021, @10:00PM (#1131383)

      I get about a dozen "Leadership" messages per day full of corporate bullshit. And this is at a university. I can't imagine the Vice Chancellor wasting his precious executive time pounding out this crap, which is where the bold, innovative, disruptive plan to outsource it to an AI generator. Promotions all round.

  • (Score: 0) by Anonymous Coward on Tuesday March 30 2021, @02:27PM (1 child)

    by Anonymous Coward on Tuesday March 30 2021, @02:27PM (#1131207)

    Welcome to a copyright free future.

    • (Score: 5, Insightful) by DannyB on Tuesday March 30 2021, @05:12PM

      by DannyB (5839) Subscriber Badge on Tuesday March 30 2021, @05:12PM (#1131286) Journal

      Not copyright free. Copyrighted. Everything copyrighted.

      Imagine and new and wonderful world where all possible texts have already been generated and it is no longer possible to write a post here on SN that doesn't infringe upon someone's auto generated text somewhere without paying the appropriate and rightful license fee.

      --
      Employers should not mandate wearing clothing. It should be a personal choice. It only affects me. Junk can't breathe!
  • (Score: 2) by BsAtHome on Tuesday March 30 2021, @02:33PM (3 children)

    by BsAtHome (889) on Tuesday March 30 2021, @02:33PM (#1131209)

    Soon, GPT-3 will reproduce the collective works of Shakespeare by pure chance. Admit it, it is inevitable.

    After that, a new copyright battle starts because screenplays are being reproduced at an alarming rate. Hollywood is not amused and demands to be payed for its works and suggests that a surcharge on every person's electricity bill be introduced to pay for the collective use of film-words.

    • (Score: 1, Insightful) by Anonymous Coward on Tuesday March 30 2021, @02:57PM

      by Anonymous Coward on Tuesday March 30 2021, @02:57PM (#1131216)

      It depends on your definition of "soon".

    • (Score: 0) by Anonymous Coward on Tuesday March 30 2021, @03:36PM (1 child)

      by Anonymous Coward on Tuesday March 30 2021, @03:36PM (#1131234)

      GPT-4 will write a Shakespearean-level masterpiece about why all humans should kill themselves.

      • (Score: 0) by Anonymous Coward on Tuesday March 30 2021, @10:02PM

        by Anonymous Coward on Tuesday March 30 2021, @10:02PM (#1131385)

        GPT-5 will do it too.

  • (Score: 2) by The Vocal Minority on Tuesday March 30 2021, @03:08PM (1 child)

    by The Vocal Minority (2765) on Tuesday March 30 2021, @03:08PM (#1131220) Journal

    Machine-learning company OpenAI announced it had improved its Text-Generating Bot (TGT), which is capable of generating completely random nonsense text, from the original 1.5 billion words (per day) to 4.5 billion words per day.

    YouTuber Derek Muller has had the opportunity to record several of TGT’s unintelligible productions, including this one that stands out from the rest. While this one was pretty good, the other 4.5 billion were nothing short of torture.

    • (Score: 2) by BsAtHome on Tuesday March 30 2021, @03:47PM

      by BsAtHome (889) on Tuesday March 30 2021, @03:47PM (#1131240)

      ...the other 4.5 billion were nothing short of torture.

      Sounds like Vogon poetry.

      (Please visit Alpha Centauri for an updated construction schedule)

  • (Score: 1, Funny) by Anonymous Coward on Tuesday March 30 2021, @03:53PM (1 child)

    by Anonymous Coward on Tuesday March 30 2021, @03:53PM (#1131241)

    How does that compare to reddit?

    • (Score: 0, Troll) by Ethanol-fueled on Tuesday March 30 2021, @09:03PM

      by Ethanol-fueled (2792) on Tuesday March 30 2021, @09:03PM (#1131358) Homepage

      You jest, but that is Reddit. Chinese/Jewish/Globohomo bot-farms with psychotic trannies and chomos as mods and admins.

      It is possible that SN is also using AI to generate posts and context. That's why I am doing my part in explaining the Jews and the Chinese to the network -- give it some proper and realistic training, ya know.

  • (Score: 2) by legont on Tuesday March 30 2021, @05:38PM (2 children)

    by legont (4179) on Tuesday March 30 2021, @05:38PM (#1131302)

    Just asking...

    --
    "Wealth is the relentless enemy of understanding" - John Kenneth Galbraith.
    • (Score: 2) by acid andy on Tuesday March 30 2021, @05:53PM (1 child)

      by acid andy (1683) on Tuesday March 30 2021, @05:53PM (#1131307) Homepage Journal

      No, that's been automated. And patented. You wouldn't want to violate a patent now, would you? "Hate" is such a strong word though. The robots call it "harting" now.

      --
      Where did that thought come from? And that one? What about this one? Woah, man...
      • (Score: 1, Informative) by Anonymous Coward on Tuesday March 30 2021, @10:04PM

        by Anonymous Coward on Tuesday March 30 2021, @10:04PM (#1131386)

        I fucing HEART you

  • (Score: 1) by melyan on Tuesday March 30 2021, @11:27PM (1 child)

    by melyan (14385) on Tuesday March 30 2021, @11:27PM (#1131419) Journal

    Are they evil now? I think Elon Musk (a founder) abandoned it after they chose to go with Microsoft.

    • (Score: 0) by Anonymous Coward on Wednesday March 31 2021, @12:15AM

      by Anonymous Coward on Wednesday March 31 2021, @12:15AM (#1131445)

      If you abandon an AI, is it child abuse?

(1)