SoylentNews

hubie [soylentnews.org] writes:

Experts find fake sources in Canadian government report that took 18 months to complete [arstechnica.com]:

On Friday, CBC News reported [www.cbc.ca] that a major education reform document [educationaccordnl.ca] prepared for the Canadian province of Newfoundland and Labrador contains at least 15 fabricated citations that academics suspect were generated by an AI language model—despite the same report calling for "ethical" AI use in schools.

[...] One of the fake citations references a 2008 National Film Board movie called "Schoolyard Games" that does not exist, according to a board spokesperson. The exact citation reportedly appears in a University of Victoria style guide, a document that teaches students how to format references using fictional examples. The style guide warns on its first page that "Many citations in this guide are fictitious," meaning they are made-up examples used only to demonstrate proper formatting. Yet someone (or some AI chatbot) copied the fake example directly into the Education Accord report as if it were a real source.

Aaron Tucker, a Memorial assistant professor whose research focuses on AI history in Canada, told CBC he could not find numerous sources cited in the report despite searching the MUN Library, other academic databases, and Google. "The fabrication of sources at least begs the question: did this come from generative AI?" Tucker told CBC. "Whether that's AI, I don't know, but fabricating sources is a telltale sign of artificial intelligence."

[...] "Errors happen. Made-up citations are a totally different thing where you essentially demolish the trustworthiness of the material," Josh Lepawsky, the former president of the Memorial University Faculty Association who resigned from the report's advisory board in January, told CBC, citing a "deeply flawed process."

The presence of potentially AI-generated fake citations becomes especially awkward given that one of the report's 110 recommendations specifically states the provincial government should "provide learners and educators with essential AI knowledge, including ethics, data privacy, and responsible technology use."

[...] The Department of Education and Early Childhood Development acknowledged awareness of "a small number of potential errors in citations" in a statement to CBC from spokesperson Lynn Robinson. "We understand that these issues are being addressed, and that the online report will be updated in the coming days to rectify any errors."

Original Submission