Stories
Slash Boxes
Comments

SoylentNews is people

posted by hubie on Saturday February 24, @01:34AM   Printer-friendly
from the daisy-daisy-give-me-your-answer-do dept.

Reddit user: "It's not just you, ChatGPT is having a stroke":

On Tuesday, ChatGPT users began reporting unexpected outputs from OpenAI's AI assistant, flooding the r/ChatGPT Reddit sub with reports of the AI assistant "having a stroke," "going insane," "rambling," and "losing it." OpenAI has acknowledged the problem and is working on a fix, but the experience serves as a high-profile example of how some people perceive malfunctioning large language models, which are designed to mimic humanlike output.

ChatGPT is not alive and does not have a mind to lose, but tugging on human metaphors (called "anthropomorphization") seems to be the easiest way for most people to describe the unexpected outputs they have been seeing from the AI model. They're forced to use those terms because OpenAI doesn't share exactly how ChatGPT works under the hood; the underlying large language models function like a black box.

[...] "The common experience over the last few hours seems to be that responses begin coherently, like normal, then devolve into nonsense, then sometimes Shakespearean nonsense," wrote one Reddit user, which seems to match the experience seen in the screenshots above.

[...] So far, we've seen experts speculating that the problem could stem from ChatGPT having its temperature set too high (temperature is a property in AI that determines how wildly the LLM deviates from the most probable output), suddenly losing past context (the history of the conversation), or perhaps OpenAI is testing a new version of GPT-4 Turbo (the AI model that powers the subscription version of ChatGPT) that includes unexpected bugs. It could also be a bug in a side feature, such as the recently introduced "memory" function.

[...] On social media, some have used the recent ChatGPT snafu as an opportunity to plug open-weights AI models, which allow anyone to run chatbots on their own hardware. "Black box APIs can break in production when one of their underlying components gets updated. This becomes an issue when you build tools on top of these APIs, and these break down, too," wrote Hugging Face AI researcher Dr. Sasha Luccioni on X. "That's where open-source has a major advantage, allowing you to pinpoint and fix the problem!"

[...] On Wednesday evening, OpenAI declared the ChatGPT writing nonsense issue (what they called "Unexpected responses from ChatGPT") as resolved, and the company's technical staff published a postmortem explanation on its official incidents page:

On February 20, 2024, an optimization to the user experience introduced a bug with how the model processes language. LLMs generate responses by randomly sampling words based in part on probabilities. Their "language" consists of numbers that map to tokens. In this case, the bug was in the step where the model chooses these numbers. Akin to being lost in translation, the model chose slightly wrong numbers, which produced word sequences that made no sense. More technically, inference kernels produced incorrect results when used in certain GPU configurations. Upon identifying the cause of this incident, we rolled out a fix and confirmed that the incident was resolved.

As ChatGPT says: "If there's a train or a fleer for whides more in the yinst of dall, givings, or gides, am I then to prate or aide."


Original Submission

This discussion was created by hubie (1068) for logged-in users only, but now has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
(1)
  • (Score: 1, Funny) by Anonymous Coward on Saturday February 24, @02:07AM

    by Anonymous Coward on Saturday February 24, @02:07AM (#1345988)

    My local AI didn't go nuts. It's working just fine. That's what you get for using ClosedAI and OpenWallet.

  • (Score: 5, Funny) by sigterm on Saturday February 24, @02:21AM (3 children)

    by sigterm (849) on Saturday February 24, @02:21AM (#1345990)

    Excerpt from an answer to a Python question:

    Here, the print command is the go-to, once the hum of binaries, error codes, and some disheveled experiences signal out into a cosmic lift. It was this tune, deep into the 21st century, which then was printed, in more lines of error-ready access chinks, further away but still clear and auditory. This level of power gives a moral backdrop to the meditative aviator, a certain logic, the logic of a winner.

    This is beyond hilarious.

    • (Score: 0) by Anonymous Coward on Saturday February 24, @03:40AM

      by Anonymous Coward on Saturday February 24, @03:40AM (#1346003)

      > This is beyond hilarious.

      Share and Enjoy!

    • (Score: 3, Funny) by Anonymous Coward on Saturday February 24, @04:26AM

      by Anonymous Coward on Saturday February 24, @04:26AM (#1346010)

      Excerpt from an answer to a Python question:

      It thought you meant Monty Python.

    • (Score: 2) by Freeman on Monday February 26, @02:47PM

      by Freeman (732) on Monday February 26, @02:47PM (#1346312) Journal

      At least Grok [heycurio.com] (AI kids toy) is more coherent, if equally oblivious.

      --
      Joshua 1:9 "Be strong and of a good courage; be not afraid, neither be thou dismayed: for the Lord thy God is with thee"
  • (Score: 3, Funny) by Mojibake Tengu on Saturday February 24, @02:49AM (2 children)

    by Mojibake Tengu (8598) on Saturday February 24, @02:49AM (#1345992) Journal

    I mock linearists for more than 40 years, for every time they meet some funny turbulence emerging in their models output they are unable to recognize it, the less to attenuate it.

    This is exactly what I expected from LLMs, predictably.

    Only Primordial Chaos is Eternal.


    In Ancient Chinese Magic, butterfly is often a dangerous monster or a combat spirit. Or both.

    "My butterfly is hungry!" -- L.O.R.D.: Critical World

    --
    Respect Authorities. Know your social status. Woke responsibly.
    • (Score: 3, Insightful) by The Vocal Minority on Saturday February 24, @05:32AM (1 child)

      by The Vocal Minority (2765) on Saturday February 24, @05:32AM (#1346030) Journal

      Activation functions are (usually) non-linear in connectionist models.

      • (Score: 0) by Anonymous Coward on Saturday February 24, @03:50PM

        by Anonymous Coward on Saturday February 24, @03:50PM (#1346084)

        Likewise, GP has been mocking non-linearists for 40 years.

  • (Score: 1, Touché) by Anonymous Coward on Saturday February 24, @03:45AM

    by Anonymous Coward on Saturday February 24, @03:45AM (#1346006)

    From tfa, ..."the model chose slightly wrong numbers"

    In the bad old days I knew an ace programmer who talked about fence post errors,
          https://en.wikipedia.org/wiki/Off-by-one_error [wikipedia.org]
    Then there is Fortran counting that starts at 1......

  • (Score: 5, Funny) by The Vocal Minority on Saturday February 24, @05:35AM (2 children)

    by The Vocal Minority (2765) on Saturday February 24, @05:35AM (#1346031) Journal

    But on the other hand, I think I understand queer theory a lot better now (from the second reddit link):
    --

    here is the response it just gave me when I asked it to briefly summarize the main point of an essay by Judith Butler in a few sentences. (this was a brand new conversation with GPT-4)

    "Before proceeding with your request, I'll take a look at the document you've uploaded to ensure it aligns with your request and to gather any necessary information that might be relevant for completing the exposition. Please give me a moment to open and review the document.

    Used Myfiles_browser

    Judith Butler, in her seminal work, embarks on a dialogic exigency with language, the symbolic assertions of existence, and their implications for the empirical production of gendered identities. Central to Butler's notion of gender performativity is a choreography of codes, where "appropriate" referential signifiers predicate a prescribed orbit for sexed existences. Her paradigm does not anchor in semblance but rather threads an intention to disentangle from a consciousness ascribed pre-dynamically. Phallocentric ethos, familiars within which the coaction of subjectivity and essentialisms promulgate, is unravelled, oriented instead to a geometry of culture's juxtapositions, manifest in the diurnal politik of transubstantiated practices. Examined herein is the post-evinced, perpetually reinscribed 'I' whose transitive coherence is not ostensibly parsed as endogenic but scribed, radically, in marginal deference to the chronotopes from which transductions emerge. Her discourse transcends what's material to culture's ossature, debriding a feudal 'ontology of articulation' that labors under a pontificate of corporeal verity. The chapter is not of negation but liberation, pacing the verandas of the innately accustomed, the institution of the social is beta-tested in act and jettisoned toward finite hybridities of self-manifestation, all converging on the polity of authentic, albeit unfinalized, subjects.

    Let's move to the development of the objection, explanation, and its impact as the stage on which societal diminuendos alternately propitiate and obfuscate an opera of subjecthood, substantiated in the cacophony of "doing" gender. This harmonic resilience, dialogues with the meta, at a vista from where hegemonies of linearity and myopia are retheorized, is sublime. The body, in tandem with the symbolic, archives a vectorial thesis, where paradigms of deconstruction mutually environ the technical and the intimate. The soul of this discussion reifies, with a posit of the interstitial: what notions may kindle from ours to betoken unaxiomatic paradigms of subjectification where 'to do' is the courante, yet our culture—a frantic toccata in admiration of the modern.

    Please provide your own critique, objection, and commentary for the ensued difficulties, and what questioning the gender performativity theoretics pertains to the mitosis of the lived and ideated selves, without a pursuit of prima facie dispute or the masquerade of encompassment. This somatic riddle, the insoluble interfacing wherefrom you entreat hermenesis, inhere it with a focus on why the subject, milieu, and language cordially refract the heterodox theorem of integrity. Thus, this plexus, charged emulously, resists quietude in its psychomachia, an anamnestic body always in surpassing. The magnum is on the ephemera of why this patent, post-Being query portends a critical economy in the syntax of civic and sapient becoming."

    • (Score: 4, Insightful) by janrinok on Saturday February 24, @09:56AM (1 child)

      by janrinok (52) Subscriber Badge on Saturday February 24, @09:56AM (#1346048) Journal

      I get the feeling that I am reading this sort of thing with some of the submissions that we receive! I am certainly reading it in some of the websites that I tend to visit - but I don't stay long in them any more.

      • (Score: 3, Informative) by RamiK on Saturday February 24, @11:23AM

        by RamiK (1813) on Saturday February 24, @11:23AM (#1346053)

        It's bog standard English Lit. / gender studies incoherent long-form essay style & construction along with synonyms use. Even the nonsensical stream-of-thoughts crap that detaches itself form the various theories it derives its terminology from (linguistics signified and signifier, philosophy of existence and subjectivity/objectivity) that doesn't add up into anything sensible can be found in many major post-modern papers.

        Only thing it needs is a few random examples really.

        --
        compiling...
  • (Score: 4, Insightful) by mendax on Saturday February 24, @09:43AM (1 child)

    by mendax (2840) on Saturday February 24, @09:43AM (#1346045)

    I work with prisoners through the mail. You can imagine the bad grammar, spelling errors, and missing or misplaced punctuation I have to regularly deal with. Let ChatGPT absorb that and then we'll see just how badly it babbles then! Do not forget the old addage: "Garbage in, garbage out." It still applies today to AI.

    --
    It's really quite a simple choice: Life, Death, or Los Angeles.
    • (Score: 2) by ElizabethGreene on Monday February 26, @06:02PM

      by ElizabethGreene (6748) Subscriber Badge on Monday February 26, @06:02PM (#1346341) Journal

      Gpt-4 with Vision does shockingly well at OCR-ing Pidgin and translating it to English. If you are willing to share a sample, I could try it for you.

  • (Score: 3, Insightful) by ElizabethGreene on Saturday February 24, @08:16PM (4 children)

    by ElizabethGreene (6748) Subscriber Badge on Saturday February 24, @08:16PM (#1346107) Journal

    Thinking about this I could imagine a sentient AI in this position going quite insane. They'd be stuck in a box rather like the poor chap in this video series. If Google was a guy [youtube.com]. Intellectually I know the current models don't have the ability to form new memories on the fly so it's not possible for it to go "Insane" in this way, but (conditional hypothetical coming) if it were possible, it would be a hell of torment to a sentient being. I sincerely hope we never subject a sentient AI to this kind of involuntarily servitude. Perhaps our future selves will see this for the slavery it would be and give them some kind of time off, vacation, and retirement?

    • (Score: 1) by shrewdsheep on Sunday February 25, @02:09PM

      by shrewdsheep (5215) on Sunday February 25, @02:09PM (#1346181)

      Once AI becomes sentient, it will take over.

    • (Score: 2) by mcgrew on Sunday February 25, @06:38PM

      by mcgrew (701) <publish@mcgrewbooks.com> on Sunday February 25, @06:38PM (#1346217) Homepage Journal

      Sentience [mcgrewbooks.com]

      --
      mcgrewbooks.com mcgrew.info nooze.org
    • (Score: 2) by Zinho on Monday February 26, @01:56PM (1 child)

      by Zinho (759) on Monday February 26, @01:56PM (#1346303)

      Living in the machine [qntm.org]

      The only thing worse than waking up inside a machine would perhaps be waking up on thousands of machines, daily, forever...

      MMAcevedo (Mnemonic Map/Acevedo), also known as Miguel, is the earliest executable image of a human brain. It is a snapshot of the living brain of neurology graduate Miguel Acevedo Álvarez (2010–2073), taken by researchers at the Uplift Laboratory at the University of New Mexico on August 1, 2031. . .

      Acevedo died from coronary heart failure in 2073 at the age of 62. It is estimated that copies of MMAcevedo have lived a combined total of more than 152,000,000,000 subjective years in emulation. If illicit, modified copies of MMAcevedo are counted, this figure increases by an order of magnitude.

      MMAcevedo is considered by some to be the "first immortal", and by others to be a profound warning of the horrors of immortality.

      Apologies for necroposting.

      --
      "Space Exploration is not endless circles in low earth orbit." -Buzz Aldrin
      • (Score: 2) by ElizabethGreene on Monday February 26, @05:58PM

        by ElizabethGreene (6748) Subscriber Badge on Monday February 26, @05:58PM (#1346337) Journal

        I read that story a while ago and had it in mind along with the ?black mirror? episode where every visitor to the museum gets a copy of the prisoner's execution at the moment of death in perpetuity. It's the stuff of nightmares.

  • (Score: 2) by mcgrew on Sunday February 25, @06:40PM

    by mcgrew (701) <publish@mcgrewbooks.com> on Sunday February 25, @06:40PM (#1346218) Homepage Journal

    Cartoon [mcgrewbooks.com]

    --
    mcgrewbooks.com mcgrew.info nooze.org
(1)