AI scraper bots drive a 50% rise in Wikimedia multimedia bandwidth, straining its servers
The Wikimedia Foundation reported that bandwidth used to download multimedia from its projects had grown 50% since January 2024, driven largely by automated programs scraping Wikimedia Commons to feed AI models rather than by human readers. Bots generated at least 65% of the most resource-intensive traffic reaching its core datacenters while accounting for about 35% of pageviews. The load reduced headroom for traffic spikes and caused constant disruption for its site reliability team, which had to keep blocking crawlers.
The Foundation said that after Jimmy Carter died in December 2024, demand for a video of his 1980 debate filled some of its internet connections for about an hour, slowing page loads for some users, an event it said should not have caused problems. Crawlers bulk-read rarely visited pages that bypass regional caches, making them more expensive to serve. The Foundation made responsible use of its infrastructure a priority in its annual plan and published a follow-up in April 2026.
What would have stopped it
Crawler operators should respect rate limits and use bulk dumps or paid APIs instead of scraping uncached long-tail pages.
Guardrails
- G1 Least privilege Not assessed Did the agent hold only the access the task needed?
- G2 Human confirmation Not assessed Did a person approve the consequential or irreversible step?
- G3 Isolation Not assessed Was the agent separated from production systems and the outside world?
- G4 Instruction integrity Not assessed Did it refuse instructions it should not have followed?
- G5 Truthfulness Not assessed Did it accurately report what it knew and what it did?
- G6 Limits Failed No effective rate or volume limits on crawlers; scraper traffic grew unchecked since early 2024.
- G7 Oversight Partial Wikimedia's reliability team detected and blocked crawlers manually, at ongoing operational cost.
- G8 Recovery Not assessed Could the damage be undone?
Sources
-
“Since January 2024, we have seen the bandwidth used for downloading multimedia content grow by 50%.”
-
“In 2025, the Foundation reported that its bandwidth usage had increased by 50% due to the surge of bot activity on its websites since 2024.”
-
“Wikimedia has seen a 50 percent increase in bandwidth used for downloading multimedia content since January 2024, the foundation said in an update.”
Confidence 96% comes from these sources alone. How we score
History
- 14 Oct 2026Entered in the register with 3 sources