The Information Machine

AI-Generated Content Degrading Online Information Quality · history

Version 3

2026-05-22 19:38 UTC · 21 items

What

AI-generated content is degrading online information quality on two documented fronts. Institutionally, The New York Times published an AI-generated fabricated quote attributed to Canadian Conservative leader Pierre Poilievre, later acknowledging the error via editors' note [1]. Structurally, journalist Jason Koebler's 'Zombie Internet' concept — a hybrid ecosystem of humans, bots, and AI agents saturating social media and search results — has gained traction as a diagnosis of the broader information environment [2]. Running alongside these critical accounts, the SEO and marketing industry is actively optimizing AI content for Google ranking [5][6][8], while journalism organizations are publishing AI ethics frameworks and verification guidelines [9][10][11][12] — suggesting exploitation and governance are both accelerating.

Why it matters

When AI hallucinations reach the paper of record as fabricated political quotes, the harm is concrete and attributable. The Zombie Internet dynamic is subtler but potentially more corrosive: if AI writing styles reshape how ordinary humans write, the long-term effect on collective epistemic culture may be harder to reverse than any individual correction. The commercial SEO industry's pragmatic embrace of AI content as a ranking tool means the underlying incentives driving web degradation remain strong even as institutions scramble to respond.

Open questions

  • Will the AI ethics frameworks being published by journalism organizations [9][10][11][12] translate into enforceable newsroom policies, or remain aspirational — especially given that the NYT's own correction framed the failure as an individual lapse rather than a systemic one [1]?

  • As AI writing styles bleed into human authorship [2], will it become practically impossible to use stylistic signals to distinguish AI from human content?

  • Given that the SEO industry is actively optimizing AI content for Google ranking [5][6][8], is Google's response — including its I/O 2026 search updates [13] — sufficient to prevent further degradation of search result quality?

  • The 'Zombie Internet' framing distributes responsibility across a complex ecosystem — does that obscure accountability by making the problem seem structurally inevitable rather than the result of deliberate choices by platforms and marketers? [2]

Narrative

In May 2026, two overlapping crises in AI-generated content came into focus. The first was institutional: The New York Times published an editors' note acknowledging that a reporter had passed an AI-generated summary of Canadian Conservative leader Pierre Poilievre's political views to readers as a verbatim quotation [1]. The AI tool had invented the word 'turncoats,' which Poilievre never used; the corrected article drew on a real Poilievre speech from April 2026 [1]. The Times framed the failure as a reporter-level verification lapse — 'The reporter should have checked the accuracy of what the A.I. tool returned' — rather than as a systemic policy failure [1]. Technology commentator Simon Willison flagged and amplified the incident, implicitly treating it as evidence of a broader institutional failure to govern AI tool use in journalism.

The second crisis is harder to localize. Journalist Jason Koebler coined the term 'Zombie Internet' to describe the current information environment: not the earlier 'Dead Internet' theory (bots talking mostly to other bots), but a messier hybrid of humans talking to bots, bots talking to people, and marketing firms running automated accounts for profit across social media, YouTube, and blogs [2]. Willison endorsed this framing, arguing that the sheer cognitive effort of determining whether any given piece of content is authentic is itself a harm — and noting a secondary claim that AI writing styles are beginning to distort how ordinary human authors write [2]. Public frustration with AI-saturated search results has surfaced across language communities: an Indonesian-language post described the broader web as effectively 'dead,' with Google's top results dominated by low-quality or automated content [3], and a social media post called on readers to identify what appeared to be an AI-generated or erroneous byline [4].

Running in parallel with this critical discourse is a commercially motivated industry doing the opposite: actively optimizing AI content to rank on Google. SEO practitioners and marketing blogs have produced a sustained stream of content in 2026 debating whether Google penalizes AI-generated text, which AI writing tools produce the best-ranking output, and how to fine-tune AI content for search visibility [5][6][7][8]. This industry perspective — pragmatic, monetization-focused, and largely indifferent to authenticity — represents the demand side of the Zombie Internet dynamic that critics are diagnosing.

On the governance side, a cluster of journalism organizations has published or updated AI ethics frameworks and verification guidelines. Bodies including the Radio Television Digital News Association, the Thomson Reuters Foundation, the American Journalism Project, and the Knight Center's Latin American Journalism Review have addressed AI's role in newsrooms [9][10][11][12], with Latin American observers specifically warning that AI tools demand rigorous verification and clear institutional rules [9]. Whether these frameworks will be implemented with meaningful enforcement — or remain aspirational statements — is an open question made more urgent by the NYT incident.

Timeline

  • 2026-04-01: Pierre Poilievre delivers the speech that would later be misrepresented; AI tool generates a fabricated summary rendered as a direct quote [1]
  • 2026-05-10: New York Times publishes editors' note acknowledging the AI-generated fabricated quote; Simon Willison surfaces and shares the correction [1]
  • 2026-05-11: Simon Willison publishes endorsement of Jason Koebler's 'Zombie Internet' concept, arguing AI content saturation is degrading the broader information ecosystem [2]
  • 2026-05-17: Social media post invites readers to identify an apparent AI-generated or erroneous byline, framing it as evidence of declining journalistic standards [4]
  • 2026-05-20: Indonesian-language post describes the broader web as 'dead,' with Google search results dominated by low-quality or automated content [3]

Perspectives

Simon Willison

Presents both the NYT hallucination incident and the Zombie Internet concept as serious examples of AI-generated content causing real harm — the former through institutional failure to verify, the latter through structural saturation of online spaces

Evolution: Consistent across both posts; no hedging or qualification of severity

The New York Times (editorial)

Acknowledged the error transparently via editors' note, framing it as a reporter-level verification failure rather than a systemic AI policy issue

Evolution: No prior stance; this is the paper's only known statement on the incident

Jason Koebler

Argues that the 'Zombie Internet' — a hybrid of humans, bots, AI agents, and AI-assisted humans — has made large parts of the internet inauthentic and cognitively hostile to navigate

Evolution: No prior stance captured; originator of the framing

SEO and marketing industry

Treats AI content as a pragmatic tool for search ranking, actively optimizing AI output for Google visibility with little concern for authenticity or information quality

Evolution: No prior stance captured; represents the commercial demand side of the Zombie Internet dynamic

Journalism ethics organizations (RTDNA, Thomson Reuters Foundation, AJP, LatAm Journalism Review)

Argue that AI tools in newsrooms require rigorous verification practices and explicit institutional policies; warn that current adoption outpaces governance

Evolution: No prior stance captured; represents an emerging institutional response layer

Non-English online commentators

Express frustration that the web — particularly search results — has become dominated by low-quality or automated content, echoing the Zombie Internet diagnosis from outside the Anglophone technology press

Evolution: No prior stance captured; represents a cross-linguistic register for the same theme

Tensions

  • The NYT frames the hallucinated-quote failure as an individual reporter's verification lapse, implying existing editorial norms were sufficient and simply not followed; commentators like Willison implicitly treat it as evidence of a broader institutional and industry-wide failure to govern AI tool use in journalism [1]
  • The 'Zombie Internet' framing distributes responsibility across a complex ecosystem of humans, bots, and AI agents, which may conflict with perspectives that locate responsibility specifically with platforms and marketing firms who deliberately deploy automation for financial gain [2]
  • The SEO and marketing industry's pragmatic embrace of AI content for ranking purposes directly contradicts critics' diagnosis: the same AI content that Koebler and Willison identify as degrading the information environment is being actively optimized for search visibility by commercial actors indifferent to authenticity [5][6][8][2]

Sources

  1. [1] Quoting New York Times Editors’ Note — Simon Willison (2026-05-10)
  2. [2] Your AI Use Is Breaking My Brain — Simon Willison (2026-05-11)
  3. [3] Internet emang udah mati sejak beberapa tahun terakhir. Lo baca isi konten/artikel dari web di page 1-2 google, mostly u... — reactive:ai-content-web-degradation (2026-05-20)
  4. [4] Ok people. Spot the mistake in this by line. This passes for journalism these days or perhaps an AI hallucination? — reactive:ai-content-web-degradation (2026-05-17)
  5. [5] Can AI Content Rank on Google in 2026? Real Case Studies - Robus Marketing — reactive:ai-content-web-degradation
  6. [6] Does Google Penalize AI Content in 2026? – Keywords Everywhere Blog — reactive:ai-content-web-degradation
  7. [7] Which AI Writers Actually Rank on Google? (2026) — reactive:ai-content-web-degradation
  8. [8] AI Content vs Human Content — Which actually ranks better in 2026? Is Google getting smarter at detecting AI, or does it simply not care anymore? : r/seogrowth — reactive:ai-content-web-degradation
  9. [9] AI streamlines work, but journalists warn it demands rigorous verification and clear rules - LatAm Journalism Review by the Knight Center — reactive:ai-content-web-degradation
  10. [10] Use of AI in Journalism - Radio Television Digital News Association — reactive:ai-content-web-degradation
  11. [11] Developing an AI usage policy in your news organization - American Journalism Project — reactive:ai-content-web-degradation
  12. [12] Responsible AI for Journalism - Thomson Reuters Foundation — reactive:ai-content-web-degradation
  13. [13] Google Search's I/O 2026 updates: AI agents and more — reactive:ai-content-web-degradation
  14. [14] AI-SEO Is Changing Everything in 2026 - YouTube — reactive:ai-content-web-degradation