Blogger Matt Webb point out that nations have begun to need a strategic fact reserve, in light of the problem arising from LLMs and other AI models starting to consume and re-process the slop which they themselves have produced.
The future needs trusted, uncontaminated, complete training data.
From the point of view of national interests, each country (or each trading bloc) will need its own training data, as a reserve, and a hedge against the interests of others.
Probably the best way to start is to take a snapshot of the internet and keep it somewhere really safe. We can sift through it later; the world's data will never be more available or less contaminated than it is today. Like when GitHub stored all public code in an Arctic vault (02/02/2020): a very-long-term archival facility 250 meters deep in the permafrost of an Arctic mountain. Or the Svalbard Global Seed Vault.
But actually I think this is a job for librarians and archivists.
What we need is a long-term national programme to slowly, carefully accept digital data into a read-only archive. We need the expertise of librarians, archivists and museums in the careful and deliberate process of acquisition and accessioning (PDF).
(Look and if this is an excuse for governments to funnel money to the cultural sector then so much the better.)
It should start today.
Already, AI slop is filling the WWW and starting to drown out legitimate, authoritative sources through sheer volume.
Previously
(2025) Meta's AI Profiles Are Already Polluting Instagram and Facebook With Slop
(2024) Thousands Turned Out For Nonexistent Halloween Parade Promoted By AI Listing
(2024) Annoyed Redditors Tanking Google Search Results Illustrates Perils of AI Scrapers
(Score: 3, Informative) by Thexalon on Tuesday January 21 2025, @05:37PM (1 child)
At least the academic libraries I've perused have had lots of really excellent bits of writing just sitting in the stacks not bothering anybody, often from a wide variety of eras. For the most part, the librarians are content to let those books stay right where they are.
The idea that librarians are rubbing their hands together in glee having successfully pushed some kind of agenda is just plain silly conspiracy theorizing, mostly by people who are pursuing a political agenda by trying to ban books that express ideas they don't like. I will also mention that the people trying to ban books often haven't even read them, they've just seen some list go by on the Internet and decided that nobody should be able to read them.
If your ideology is capable of being completely destroyed by its adherents reading or hearing about competing ideologies, then there's a good chance that your ideology is incorrect or immoral and deserves to go away.
"Think of how stupid the average person is. Then realize half of 'em are stupider than that." - George Carlin
(Score: 3, Informative) by Freeman on Tuesday January 21 2025, @06:09PM
I've worked in an academic library for nearly 20 years. Perhaps the biggest issue we've faced, essentially the entire time has been the perception that people can just Google stuff. Why does the Library even exist? The running gag is "Do you think our budget will be the same as it has been for the last 20 years?" The budget for our Library has essentially not changed in over 20 years. Yet database vendors want an extra 3% or more, every year. Looking at the state of Universities in general in the USA. We're not doing so great.
Joshua 1:9 "Be strong and of a good courage; be not afraid, neither be thou dismayed: for the Lord thy God is with thee"