SoylentNews
SoylentNews is people
https://soylentnews.org/

Title    OpenAI Admits That AI Writing Detectors Don't Work
Date    Tuesday September 12 2023, @07:31AM
Author    hubie
Topic   
from the burn-it-all-down dept.
https://soylentnews.org/article.pl?sid=23/09/11/0452224

Freeman writes:

https://arstechnica.com/information-technology/2023/09/openai-admits-that-ai-writing-detectors-dont-work/

Last week, OpenAI published tips for educators in a promotional blog post that shows how some teachers are using ChatGPT as an educational aid, along with suggested prompts to get started. In a related FAQ, they also officially admit what we already know: AI writing detectors don't work, despite frequently being used to punish students with false positives.

In a section of the FAQ titled "Do AI detectors work?", OpenAI writes, "In short, no. While some (including OpenAI) have released tools that purport to detect AI-generated content, none of these have proven to reliably distinguish between AI-generated and human-generated content."

In July, we covered in depth why AI writing detectors such as GPTZero don't work, with experts calling them "mostly snake oil."
[...]
That same month, OpenAI discontinued its AI Classifier, which was an experimental tool designed to detect AI-written text. It had an abysmal 26 percent accuracy rate.


Original Submission

Links

  1. "Freeman" - https://soylentnews.org/~Freeman/
  2. "tips for educators" - https://openai.com/blog/teaching-with-ai
  3. "ChatGPT" - https://arstechnica.com/information-technology/2022/12/openai-invites-everyone-to-test-new-ai-powered-chatbot-with-amusing-results/
  4. "FAQ" - https://help.openai.com/en/collections/5929286-educator-faq
  5. "punish students" - https://www.google.com/search?client=firefox-b-1-d&q=accused+of+using+AI+site:reddit.com
  6. "writes" - https://help.openai.com/en/articles/8313351-how-can-educators-respond-to-students-presenting-ai-generated-content-as-their-own
  7. "we covered" - https://arstechnica.com/information-technology/2023/07/why-ai-detectors-think-the-us-constitution-was-written-by-ai/
  8. "discontinued" - https://arstechnica.com/information-technology/2023/07/openai-discontinues-its-ai-writing-detector-due-to-low-rate-of-accuracy/
  9. "Original Submission" - https://soylentnews.org/submit.pl?op=viewsub&subid=60729

© Copyright 2024 - SoylentNews, All Rights Reserved

printed from SoylentNews, OpenAI Admits That AI Writing Detectors Don't Work on 2024-11-09 18:46:25