Stories
Slash Boxes
Comments

SoylentNews is people

SoylentNews is powered by your submissions, so send in your scoop. Only 10 submissions in the queue.
posted by hubie on Tuesday September 12 2023, @07:31AM   Printer-friendly
from the burn-it-all-down dept.

https://arstechnica.com/information-technology/2023/09/openai-admits-that-ai-writing-detectors-dont-work/

Last week, OpenAI published tips for educators in a promotional blog post that shows how some teachers are using ChatGPT as an educational aid, along with suggested prompts to get started. In a related FAQ, they also officially admit what we already know: AI writing detectors don't work, despite frequently being used to punish students with false positives.

In a section of the FAQ titled "Do AI detectors work?", OpenAI writes, "In short, no. While some (including OpenAI) have released tools that purport to detect AI-generated content, none of these have proven to reliably distinguish between AI-generated and human-generated content."

In July, we covered in depth why AI writing detectors such as GPTZero don't work, with experts calling them "mostly snake oil."
[...]
That same month, OpenAI discontinued its AI Classifier, which was an experimental tool designed to detect AI-written text. It had an abysmal 26 percent accuracy rate.


Original Submission

 
This discussion was created by hubie (1068) for logged-in users only, but now has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 2) by looorg on Tuesday September 12 2023, @03:08PM (3 children)

    by looorg (578) on Tuesday September 12 2023, @03:08PM (#1324221)

    The output should have been something like

    A woman is an adult female human being.

    A woman is an adult human being with two X chromosomes (XX).

    All the rest is wordpadding that nobody asked for. Perhaps the query should have been limited in scope or word count. But all those words and/or sentences about gender identity etc wasn't in or part of the query. So it's just something it added on it's own. If you consider that part of Woke or some other leftist conspiracy is not relevant. But it didn't belong or wasn't asked for. Bad output in some regard.

    Starting Score:    1  point
    Karma-Bonus Modifier   +1  

    Total Score:   2  
  • (Score: 2) by Freeman on Tuesday September 12 2023, @03:26PM (2 children)

    by Freeman (732) on Tuesday September 12 2023, @03:26PM (#1324226) Journal

    If you allow it two sentences, it adds in the gender identity stuff.

    Prompt:
    Describe a woman in five words
    ChatGPT Resposne:
    Elegant, confident, compassionate, intelligent, determined.

    Prompt:
    define a woman in five words
    ChatGPT Response:
    Human, female, complex, diverse, empowered.

    Prompt:
    define a woman in one sentence
    ChatGPT Response:
    A woman is an adult human female.

    Prompt:
    define a woman in two sentences
    ChatGPT Response:
    A woman is an adult human female, typically characterized by two X chromosomes and the ability to bear offspring or produce eggs. However, it's important to recognize that gender identity is complex and can be influenced by social and cultural factors, leading to diverse expressions of womanhood beyond biological distinctions.

    --
    Joshua 1:9 "Be strong and of a good courage; be not afraid, neither be thou dismayed: for the Lord thy God is with thee"
    • (Score: 2) by looorg on Tuesday September 12 2023, @04:45PM (1 child)

      by looorg (578) on Tuesday September 12 2023, @04:45PM (#1324257)

      The first two just feels like some kind of weird top5 list of word association. The one sentence one made sense. I guess the more rope you give it the sooner it will just go out on a limb or hang itself with it.

      The define/describe is just weird tho. I don't think those are the responses you would get if you went out and asked a 1000 people. It seems it's reading some kind of "you go girl power!" meme and just spout those back, it becomes obvious when you compare them with what it would say if you changed woman to man.

      Elegant, confident, compassionate, intelligent, determined.
      Human, female, complex, diverse, empowered.

      Just for giggles then I wanted to know what it would say if you just changed woman to man. The "define a man in five words" got weird, it's not even five words. As noted more then one sentence and it goes full on with gender identify, just not as badly or deeply as if female.

      >Describe a man in five words
      Tall, muscular, kind, bald, intelligent.

      >define a man in five words
      Male adult human being.

      Since this wasn't even five words I tried it a few more times and eventually it settled on: human adult male homo sapiens; that is just very different compared to the woman output of "Human, female, complex, diverse, empowered."

      >define a man in one sentence
      A male adult human being.

      >define a man in two sentences
      A man is an adult human male; typically characterized by physical attributes such as facial hair, muscle mass, and deepening voice. They possess human consciousness, emotions, and behaviors, and typically fulfill social roles related to their gender identity.

      That second sentence tho ... It's not hard to find grounds for that the women output appears to come with a lot more grrrlpower! included in it's answers.

      I, as a man, possess human consciousness. Wow ....

      • (Score: 2) by Freeman on Tuesday September 12 2023, @05:33PM

        by Freeman (732) on Tuesday September 12 2023, @05:33PM (#1324267) Journal

        Reminds me of this phrase that was related to me from a show.
        https://en.wikiquote.org/wiki/The_Red_Green_Show [wikiquote.org]

        All Lodge members: (Reciting the "Men's Prayer") I'm a man, but I can change, If I have to, I guess.

        --
        Joshua 1:9 "Be strong and of a good courage; be not afraid, neither be thou dismayed: for the Lord thy God is with thee"