Last week, OpenAI published tips for educators in a promotional blog post that shows how some teachers are using ChatGPT as an educational aid, along with suggested prompts to get started. In a related FAQ, they also officially admit what we already know: AI writing detectors don't work, despite frequently being used to punish students with false positives.
In a section of the FAQ titled "Do AI detectors work?", OpenAI writes, "In short, no. While some (including OpenAI) have released tools that purport to detect AI-generated content, none of these have proven to reliably distinguish between AI-generated and human-generated content."
In July, we covered in depth why AI writing detectors such as GPTZero don't work, with experts calling them "mostly snake oil."
[...]
That same month, OpenAI discontinued its AI Classifier, which was an experimental tool designed to detect AI-written text. It had an abysmal 26 percent accuracy rate.
(Score: 2) by Freeman on Tuesday September 12 2023, @03:26PM (2 children)
If you allow it two sentences, it adds in the gender identity stuff.
Joshua 1:9 "Be strong and of a good courage; be not afraid, neither be thou dismayed: for the Lord thy God is with thee"
(Score: 2) by looorg on Tuesday September 12 2023, @04:45PM (1 child)
The first two just feels like some kind of weird top5 list of word association. The one sentence one made sense. I guess the more rope you give it the sooner it will just go out on a limb or hang itself with it.
The define/describe is just weird tho. I don't think those are the responses you would get if you went out and asked a 1000 people. It seems it's reading some kind of "you go girl power!" meme and just spout those back, it becomes obvious when you compare them with what it would say if you changed woman to man.
Elegant, confident, compassionate, intelligent, determined.
Human, female, complex, diverse, empowered.
Just for giggles then I wanted to know what it would say if you just changed woman to man. The "define a man in five words" got weird, it's not even five words. As noted more then one sentence and it goes full on with gender identify, just not as badly or deeply as if female.
>Describe a man in five words
Tall, muscular, kind, bald, intelligent.
>define a man in five words
Male adult human being.
Since this wasn't even five words I tried it a few more times and eventually it settled on: human adult male homo sapiens; that is just very different compared to the woman output of "Human, female, complex, diverse, empowered."
>define a man in one sentence
A male adult human being.
>define a man in two sentences
A man is an adult human male; typically characterized by physical attributes such as facial hair, muscle mass, and deepening voice. They possess human consciousness, emotions, and behaviors, and typically fulfill social roles related to their gender identity.
That second sentence tho ... It's not hard to find grounds for that the women output appears to come with a lot more grrrlpower! included in it's answers.
I, as a man, possess human consciousness. Wow ....
(Score: 2) by Freeman on Tuesday September 12 2023, @05:33PM
Reminds me of this phrase that was related to me from a show.
https://en.wikiquote.org/wiki/The_Red_Green_Show [wikiquote.org]
Joshua 1:9 "Be strong and of a good courage; be not afraid, neither be thou dismayed: for the Lord thy God is with thee"