SoylentNews
SoylentNews is people
https://soylentnews.org/

upstart writes:

Reddit user: "It's not just you, ChatGPT is having a stroke":

On Tuesday, ChatGPT users began reporting unexpected outputs from OpenAI's AI assistant, flooding the r/ChatGPT Reddit sub with reports of the AI assistant "having a stroke," "going insane," "rambling," and "losing it." OpenAI has acknowledged the problem and is working on a fix, but the experience serves as a high-profile example of how some people perceive malfunctioning large language models, which are designed to mimic humanlike output.

ChatGPT is not alive and does not have a mind to lose, but tugging on human metaphors (called "anthropomorphization") seems to be the easiest way for most people to describe the unexpected outputs they have been seeing from the AI model. They're forced to use those terms because OpenAI doesn't share exactly how ChatGPT works under the hood; the underlying large language models function like a black box.

[...] "The common experience over the last few hours seems to be that responses begin coherently, like normal, then devolve into nonsense, then sometimes Shakespearean nonsense," wrote one Reddit user, which seems to match the experience seen in the screenshots above.

[...] So far, we've seen experts speculating that the problem could stem from ChatGPT having its temperature set too high (temperature is a property in AI that determines how wildly the LLM deviates from the most probable output), suddenly losing past context (the history of the conversation), or perhaps OpenAI is testing a new version of GPT-4 Turbo (the AI model that powers the subscription version of ChatGPT) that includes unexpected bugs. It could also be a bug in a side feature, such as the recently introduced "memory" function.

[...] On social media, some have used the recent ChatGPT snafu as an opportunity to plug open-weights AI models, which allow anyone to run chatbots on their own hardware. "Black box APIs can break in production when one of their underlying components gets updated. This becomes an issue when you build tools on top of these APIs, and these break down, too," wrote Hugging Face AI researcher Dr. Sasha Luccioni on X. "That's where open-source has a major advantage, allowing you to pinpoint and fix the problem!"

[...] On Wednesday evening, OpenAI declared the ChatGPT writing nonsense issue (what they called "Unexpected responses from ChatGPT") as resolved, and the company's technical staff published a postmortem explanation on its official incidents page:

On February 20, 2024, an optimization to the user experience introduced a bug with how the model processes language. LLMs generate responses by randomly sampling words based in part on probabilities. Their "language" consists of numbers that map to tokens. In this case, the bug was in the step where the model chooses these numbers. Akin to being lost in translation, the model chose slightly wrong numbers, which produced word sequences that made no sense. More technically, inference kernels produced incorrect results when used in certain GPU configurations. Upon identifying the cause of this incident, we rolled out a fix and confirmed that the incident was resolved.

As ChatGPT says: "If there's a train or a fleer for whides more in the yinst of dall, givings, or gides, am I then to prate or aide."

Original Submission

1. "upstart" - https://soylentnews.org/~upstart/
2. "Reddit user: "It's not just you, ChatGPT is having a stroke"" - https://arstechnica.com/information-technology/2024/02/chatgpt-alarms-users-by-spitting-out-shakespearean-nonsense-and-rambling/
3. "ChatGPT" - https://arstechnica.com/information-technology/2023/11/chatgpt-was-the-spark-that-lit-the-fire-under-generative-ai-one-year-ago-today/
4. "having a stroke" - https://www.reddit.com/r/ChatGPT/comments/1avw1sv/its_not_just_you_gpt_is_having_a_stroke/
5. "going insane" - https://www.reddit.com/r/ChatGPT/comments/1avumfh/has_chatgpt_gone_temporarily_insane/
6. "rambling" - https://www.reddit.com/r/ChatGPT/comments/1avwqzh/very_strange_rambling_responses/
7. "losing it" - https://www.reddit.com/r/ChatGPT/comments/1avydjd/anyone_else_experiencing_chatgpt_losing_it/
8. "acknowledged the problem" - https://status.openai.com/incidents/ssg8fh7sfyz3
9. "large language models" - https://arstechnica.com/science/2023/07/a-jargon-free-explanation-of-how-ai-large-language-models-work/
10. "doesn't share" - https://arstechnica.com/information-technology/2023/07/is-chatgpt-getting-worse-over-time-study-claims-yes-but-others-arent-sure/
11. "black box" - https://arstechnica.com/information-technology/2023/05/openai-peeks-into-the-black-box-of-neural-networks-with-new-research/
12. "wrote" - https://www.reddit.com/r/ChatGPT/comments/1aw04zs/clearly_something_is_very_wrong_with_chatgpt/
13. "temperature" - https://www.coltsteele.com/tips/understanding-openai-s-temperature-parameter
14. "GPT-4 Turbo" - https://arstechnica.com/information-technology/2023/11/openai-introduces-gpt-4-turbo-larger-memory-lower-cost-new-knowledge/
15. "recently introduced "memory" function" - https://arstechnica.com/information-technology/2024/02/amnesia-begone-soon-chatgpt-will-remember-what-you-tell-it-between-sessions/
16. "open-weights AI models" - https://arstechnica.com/information-technology/2023/07/meta-launches-llama-2-an-open-source-ai-model-that-allows-commercial-applications/
17. "wrote" - https://x.com/SashaMTL/status/1760283264118317394?s=20
18. "official incidents page" - https://status.openai.com/incidents/ssg8fh7sfyz3
19. "Original Submission" - https://soylentnews.org/submit.pl?op=viewsub&subid=62151

printed from SoylentNews, ChatGPT Goes Temporarily “Insane” With Unexpected Outputs, Spooking Users on 2025-07-05 17:26:42