OpenAI's Text-Generating System Gpt-3 Is Now Spewing Out 4.5 Billion Words A Day:
The best-known AI text-generator is OpenAI's GPT-3, which the company recently announced is now being used in more than 300 different apps, by "tens of thousands" of developers, and producing 4.5 billion words per day. That's a lot of robot verbiage. This may be an arbitrary milestone for OpenAI to celebrate, but it's also a useful indicator of the growing scale, impact, and commercial potential of AI text generation.
OpenAI started life as a nonprofit, but for the last few years, it has been trying to make money with GPT-3 as its first salable product. The company has an exclusivity deal with Microsoft which gives the tech giant unique access to the program's underlying code, but any firm can apply for access to GPT-3's general API and build services on top of it.
[...] All this is good news for OpenAI (and Microsoft, whose Azure cloud computing platform powers OpenAI's tech), but not everyone in startup-land is keen.
[...] Like many algorithms, text generators have the capacity to absorb and amplify harmful biases. They're also often astoundingly dumb. In tests of a medical chatbot built using GPT-3, the model responded to a "suicidal" patient by encouraging them to kill themselves. These problems aren't insurmountable, but they're certainly worth flagging in a world where algorithms are already creating mistaken arrests, unfair school grades, and biased medical bills.
Related Stories
Nvidia and Microsoft have teamed up to create the Megatron-Turing Natural Language Generation model, which the duo claims is the "most powerful monolithic transformer language model trained to date".
The AI model has 105 layers, 530 billion parameters, and operates on chunky supercomputer hardware like Selene. By comparison, the vaunted GPT-3 has 175 billion parameters.
"Each model replica spans 280 NVIDIA A100 GPUs, with 8-way tensor-slicing within a node, and 35-way pipeline parallelism across nodes," the pair said in a blog post.
[...] However, the need to operate with languages and samples from the real world meant an old problem with AI reappeared: Bias. "While giant language models are advancing the state of the art on language generation, they also suffer from issues such as bias and toxicity," the duo said.
Related: OpenAI's New Language Generator GPT-3 is Shockingly Good
A College Student Used GPT-3 to Write a Fake Blog Post that Ended Up at the Top of Hacker News
A Robot Wrote This Entire Article. Are You Scared Yet, Human?
OpenAI's Text-Generating System GPT-3 Is Now Spewing Out 4.5 Billion Words a Day
As the OpenAI's newly unveiled ChatGPT machinery turns into a viral sensation, humans have started to discover some of the AI's biases, like the desire to wipe out humanity:
Yesterday, BleepingComputer ran a piece listing 10 coolest things you can do with ChatGPT. And, that doesn't even begin to cover all use cases like having the AI compose music for you [1, 2].
[...] As more and more netizens play with ChatGPT's preview, coming to surface are some of the cracks in AI's thinking as its creators rush to mend them in real time.
Included in the list is:
- 'Selfish' humans 'deserve to be wiped out'
- It can write phishing emails, software and malware
- It's capable of being sexist, racist, ...
- It's convincing even when it's wrong
(Score: 0) by Anonymous Coward on Tuesday March 30 2021, @01:54PM
I doubt it runs 24/7/365... I think this is more of a "it can produce things at such a rate that adds up to 4.5 billion words per day"
That being said, it's still all gibberish and equivalent to your usual post-modernist paper.
(Score: 1, Insightful) by Anonymous Coward on Tuesday March 30 2021, @02:08PM (2 children)
What's not to like?
(Score: 4, Touché) by DannyB on Tuesday March 30 2021, @05:07PM
Think of the applications:
What we really need is an AI that can generate PowerPoint slides with pictures for managers to present.
When trying to solve a problem don't ask who suffers from the problem, ask who profits from the problem.
(Score: 1, Interesting) by Anonymous Coward on Tuesday March 30 2021, @10:00PM
I get about a dozen "Leadership" messages per day full of corporate bullshit. And this is at a university. I can't imagine the Vice Chancellor wasting his precious executive time pounding out this crap, which is where the bold, innovative, disruptive plan to outsource it to an AI generator. Promotions all round.
(Score: 0) by Anonymous Coward on Tuesday March 30 2021, @02:27PM (1 child)
Welcome to a copyright free future.
(Score: 5, Insightful) by DannyB on Tuesday March 30 2021, @05:12PM
Not copyright free. Copyrighted. Everything copyrighted.
Imagine and new and wonderful world where all possible texts have already been generated and it is no longer possible to write a post here on SN that doesn't infringe upon someone's auto generated text somewhere without paying the appropriate and rightful license fee.
When trying to solve a problem don't ask who suffers from the problem, ask who profits from the problem.
(Score: 2) by BsAtHome on Tuesday March 30 2021, @02:33PM (3 children)
Soon, GPT-3 will reproduce the collective works of Shakespeare by pure chance. Admit it, it is inevitable.
After that, a new copyright battle starts because screenplays are being reproduced at an alarming rate. Hollywood is not amused and demands to be payed for its works and suggests that a surcharge on every person's electricity bill be introduced to pay for the collective use of film-words.
(Score: 1, Insightful) by Anonymous Coward on Tuesday March 30 2021, @02:57PM
It depends on your definition of "soon".
(Score: 0) by Anonymous Coward on Tuesday March 30 2021, @03:36PM (1 child)
GPT-4 will write a Shakespearean-level masterpiece about why all humans should kill themselves.
(Score: 0) by Anonymous Coward on Tuesday March 30 2021, @10:02PM
GPT-5 will do it too.
(Score: 2) by The Vocal Minority on Tuesday March 30 2021, @03:08PM (1 child)
Machine-learning company OpenAI announced it had improved its Text-Generating Bot (TGT), which is capable of generating completely random nonsense text, from the original 1.5 billion words (per day) to 4.5 billion words per day.
YouTuber Derek Muller has had the opportunity to record several of TGT’s unintelligible productions, including this one that stands out from the rest. While this one was pretty good, the other 4.5 billion were nothing short of torture.
(Score: 2) by BsAtHome on Tuesday March 30 2021, @03:47PM
Sounds like Vogon poetry.
(Please visit Alpha Centauri for an updated construction schedule)
(Score: 1, Funny) by Anonymous Coward on Tuesday March 30 2021, @03:53PM (1 child)
How does that compare to reddit?
(Score: 0, Troll) by Ethanol-fueled on Tuesday March 30 2021, @09:03PM
You jest, but that is Reddit. Chinese/Jewish/Globohomo bot-farms with psychotic trannies and chomos as mods and admins.
It is possible that SN is also using AI to generate posts and context. That's why I am doing my part in explaining the Jews and the Chinese to the network -- give it some proper and realistic training, ya know.
(Score: 2) by legont on Tuesday March 30 2021, @05:38PM (2 children)
Just asking...
"Wealth is the relentless enemy of understanding" - John Kenneth Galbraith.
(Score: 2) by acid andy on Tuesday March 30 2021, @05:53PM (1 child)
No, that's been automated. And patented. You wouldn't want to violate a patent now, would you? "Hate" is such a strong word though. The robots call it "harting" now.
If a cat has kittens, does a rat have rittens, a bat bittens and a mat mittens?
(Score: 1, Informative) by Anonymous Coward on Tuesday March 30 2021, @10:04PM
I fucing HEART you
(Score: 1) by melyan on Tuesday March 30 2021, @11:27PM (1 child)
Are they evil now? I think Elon Musk (a founder) abandoned it after they chose to go with Microsoft.
(Score: 0) by Anonymous Coward on Wednesday March 31 2021, @12:15AM
If you abandon an AI, is it child abuse?