Wikipedia has a new initiative called WikiProject AI Cleanup. It is a task force of volunteers currently combing through Wikipedia articles, editing or removing false information that appears to have been posted by people using generative AI.
Ilyas Lebleu, a founding member of the cleanup crew, told 404 Media that the crisis began when Wikipedia editors and users began seeing passages that were unmistakably written by a chatbot of some kind.
As for why this is happening, the cleanup crew thinks there are three primary reasons.
“[The] main reasons that motivate editors to add AI-generated content: self-promotion, deliberate hoaxing, and being misinformed into thinking that the generated content is accurate and constructive,”
That last one. Ouch.
The vast majority of people think they’re the good guys…
Well, I was in doubt, so I asked the AI whether I could trust the answers and it told me not to worry about it. That must mean that I only get accurate answers, right? /s
Best case is that the model used to generate this content was originally trained by data from Wikipedia so it “just” generates a worse, hallucinated “variant” of the original information. Goes to show how stupid this idea is.
Imagine this in a loop: AI trained by Wikipedia that then alters content on Wikipedia, which in turn gets picked up by the next model trained. It would just get worse and worse, similar to how converting the same video over and over again yields continuously worse results.
Yes, this is what many of us worry will become the internet in general. AI content generated on from AI trained on AI garbage.
AI bots can trivially outpace humans.
I was just discussing with a friend of mine how we’re rapidly approaching the dead internet. At some point, many websites will likely just be chat bots talking to other chat bots, which then gets used to train further chat bots. Human made content is already becoming harder and harder to find on algorithm heavy websites like Reddit and facebooks suite of sites. The bots can easily outpace any algorithmic changes they might make to help deter them, but my fb using family members all constantly block those weird Jesus accounts and they still show up constantly
Eventually every article just reads “Delve delve delve delve delve delve delve.”
A very similar situation to that analysed in this paper that was recently published. The quality of what is generated degrades significantly.
Although they mostly investigate replacing the data with ai generated data in each step, so I doubt the effect will be as pronounced in practice. Human writing will still be included and even curation of ai generated text by people can skew the distribution of the training data (as the process by these editors would inevitably do, as reasonable text could get through the cracks.)
AI model makers are very well aware of this and there is a move from ingesting everything to curating datasets more aggressively. Data prep is something many upstarts have no idea is critical, but everyone is learning about, sometimes the hard way.
Every article would end up being the philosophy page.
Jesus Christ. The amount of absolute bellends in the world never ceases to confound me.
They used to be contained, every village has their idiot. Now that the internet is the global village, all the formerly isolated idiots have a place to chat.
If anyone can survive the AI text apocalypse, it is wikipedia. They have been fending off and regulating article writing bots since someone coded up a US town article writer from the 2000 census (not the 2010 or 2020 census, the 2000 census. This bot was writing wikipedia articles in 2003)
Hopefully they tightened things up after the Scots incident.
What Scots incident?
A considerable number of the articles written in Scots weren’t written in Scots. The most prolific writer of the Scots articles was an American teen with no knowledge of Scots, and was more or less just writing them in a Scottish accent.
Yep, I recalled that.
A certain amount of Russians with Cossack roots would do this with Ukrainian on the web, causing a bit less butthurt because TBH a lot of Ukrainians don’t speak in any way proper Ukrainian, but a mix of Ukrainian and Russian, and a lot of the rest talk dialects still different from standard.
Ah. That.
why the fuck would anyone stick ai shit on wikipedia that doesn’t make any sense
“[The] main reasons that motivate editors to add AI-generated content: self-promotion, deliberate hoaxing, and being misinformed into thinking that the generated content is accurate and constructive,” Lebleu said.
so, stupidity basically. they’re just stupid.
Many people who are trying to push lies have an agenda to undermine Wikipedia. Trump, Putin supporters, etc.
People suck
The irony being a huge amount of the llm knowledge was based on WP in the first place, that and scientific papers.
This is why we can’t have nice things
Damn Putin, you’re retarded.
Require someone that wants to add stuff to pay a small amount to the Wikimedia Foundation for activating their account and refund it if they moderate a certain amount.
Yeah I mean I’ve had minor edits reversed because I didn’t source the fact properly
And that was like 10 years ago I’m surprised these edits are getting through in the first place
Seems like that would be an easy problem to solve… require all edits to have a peer review by someone with a minimum credibility before they go live. I can understand when Wikipedia was new, allowing anyone to post edits or new content helped them get going. But now? Why do they still allow any random person to post edits without a minimal amount of verification? Sure it self-corrects given enough time, but meanwhile what happens to all the people looking for factual information and finding trash?
Or at least give it a certain amount of time before it goes live. So if nobody comes around to approve it in 24 hours, it goes live.
Usually bad edits are corrected within hours, if not minutes, so that should catch the lion’s share w/o bogging down the approval queue too much.
Croudsourcing is the strenght that led to the vast resource and also the weakness as displayed here. So probably there will be a need for some form of barrier. Hence my suggestion.
Link it to your real identity, brilliant idea 👌
Oh God. This is horrible news. So incredibly frustrating to hear.
It’s over. We lost.
