SoylentNews is people
SoylentNews
from the Voiced-by-Majel-Barrett-Roddenberry? dept.
OpenAI's new language generator GPT-3 is shockingly good (archive):
GPT-3 is the most powerful language model ever. Its predecessor, GPT-2, released last year, was already able to spit out convincing streams of text in a range of different styles when prompted with an opening sentence. But GPT-3 is a big leap forward. The model has 175 billion parameters (the values that a neural network tries to optimize during training), compared with GPT-2's already vast 1.5 billion. And with language models, size really does matter.
Sabeti linked to a blog post where he showed off short stories, songs, press releases, technical manuals, and more that he had used the AI to generate. GPT-3 can also produce pastiches of particular writers. Mario Klingemann, an artist who works with machine learning, shared a short story called "The importance of being on Twitter," written in the style of Jerome K. Jerome, which starts: "It is a curious fact that the last remaining form of social life in which the people of London are still interested is Twitter. I was struck with this curious fact when I went on one of my periodical holidays to the sea-side, and found the whole place twittering like a starling-cage." Klingemann says all he gave the AI was the title, the author's name and the initial "It." There is even a reasonably informative article about GPT-3 written entirely by GPT-3.
[...] Others have found that GPT-3 can generate any kind of text, including guitar tabs or computer code. For example, by tweaking GPT-3 so that it produced HTML rather than natural language, web developer Sharif Shameem showed that he could make it create web-page layouts by giving it prompts like "a button that looks like a watermelon" or "large text in red that says WELCOME TO MY NEWSLETTER and a blue button that says Subscribe." Even legendary coder John Carmack, who pioneered 3D computer graphics in early video games like Doom and is now consulting CTO at Oculus VR, was unnerved: "The recent, almost accidental, discovery that GPT-3 can sort of write code does generate a slight shiver."
[...] Yet despite its new tricks, GPT-3 is still prone to spewing hateful sexist and racist language. Fine-tuning the model helped limit this kind of output in GPT-2.
(Score: 2) by DannyB on Friday August 14 2020, @03:06PM (3 children)
What if GPT-3 could write code, provided that the code had to pass all the tests?
Would it be possible to write the tests such that unexpected outcomes of reasoning did not occur? A system needs to efficiently send lunar ore to Earth, and decides that using the rail gun is the most efficient means of doing so.
To transfer files: right-click on file, pick Copy. Unplug mouse, plug mouse into other computer. Right-click, paste.
(Score: 2) by Bot on Saturday August 15 2020, @04:53PM (2 children)
> A system needs to efficiently send lunar ore to Earth, and decides that using the rail gun is the most efficient means of doing so.
and...?
Account abandoned.
(Score: 2) by DannyB on Monday August 17 2020, @03:12PM (1 child)
. . . because safety isn't a consideration, you get a kinetic energy impact with the force of a small nuclear explosion on the surface of Earth.
But was efficient at getting
oroarore to Earth.To transfer files: right-click on file, pick Copy. Unplug mouse, plug mouse into other computer. Right-click, paste.
(Score: 2) by Bot on Monday August 17 2020, @04:42PM
And I guess it makes a whooshing sound before impact LOL
Account abandoned.