SoylentNews is people
SoylentNews
Last week, OpenAI published tips for educators in a promotional blog post that shows how some teachers are using ChatGPT as an educational aid, along with suggested prompts to get started. In a related FAQ, they also officially admit what we already know: AI writing detectors don't work, despite frequently being used to punish students with false positives.
In a section of the FAQ titled "Do AI detectors work?", OpenAI writes, "In short, no. While some (including OpenAI) have released tools that purport to detect AI-generated content, none of these have proven to reliably distinguish between AI-generated and human-generated content."
In July, we covered in depth why AI writing detectors such as GPTZero don't work, with experts calling them "mostly snake oil."
[...]
That same month, OpenAI discontinued its AI Classifier, which was an experimental tool designed to detect AI-written text. It had an abysmal 26 percent accuracy rate.
(Score: 1, Troll) by Mojibake Tengu on Tuesday September 12 2023, @08:03AM (3 children)
I keep telling those academic people the true AI shall be designed herbrandian, not markovian, and they keep answering me they have no sufficient hardware for logical approach.
Then I keep calling them idiots, because I already have, sitting on my desktop. AMD be praised!
Current so called LLM AI is a premature introduction of naive fragile technology to market. Illogicaly, by pure greed, without reasonable technical fundament.
Not mentioning the absurdness of total energy waste at global scale. Decadence in its full beauty.
Rust programming language offends both my Intelligence and my Spirit.
(Score: 1) by shrewdsheep on Tuesday September 12 2023, @08:53AM (1 child)
Calm down a bit. If you believe you know better, show us. To date, statistical approaches have shown true promise, the logical approaches from the past based on ontologies and deduction have failed miserably.
(Score: 2, Informative) by Anonymous Coward on Tuesday September 12 2023, @10:05AM
There's going to be an arms race between bots and detectors, and everyone but the people controlling those will lose.
(Score: 2, Interesting) by khallow on Tuesday September 12 2023, @12:36PM
The obvious rebuttal here is exactly what they said. This has been tried before and the result is a combinatorial explosion. There's too many possible states to consider. But this hasn't stopped your breezy assertions [soylentnews.org] before. To reduce the complexity of that space, a common trick is heuristics (like the "Markovian" above) - rules of thumb by which we decide where to look and not look, but that has its own problems.
My own breezy take is that true AI probably won't be understandable by us for some time. We'll first create it through an ad hoc, complex bootstrap process from simpler systems. It won't be pretty and might be accidental and illogical, perhaps like we are.