SoylentNews

looorg [soylentnews.org] writes:

Other peoples code might look good at a glance but is wrong at least half the time. AI or help sites don't offer as much help as one would think.

"Among other findings, the authors found ChatGPT is more likely to make conceptual errors than factual ones. "Many answers are incorrect due to ChatGPT’s incapability to understand the underlying context of the question being asked," the paper found."

""Stack Overflow’s annual Developer Survey of 90,000 coders recently found that 77 percent of developers are favorable of AI tools, but only 42 percent trust the accuracy of those tools. OverflowAI developed with community at the core and with a focus on the accuracy of data and AI-generated content."

https://www.theregister.com/2023/08/07/chatgpt_stack_overflow_ai/ [theregister.com]
https://arxiv.org/abs/2308.02312 [arxiv.org]

Original Submission