The Information Machine

AI Models as Tools and Targets in Foreign State Disinformation Campaigns

closed · v4 · 2026-06-18 · 77 items · history

What's new in v4

New items this pass are further social media amplification of the June 10 OpenAI disclosure, now including Chinese- and Japanese-language posts and cross-platform sharing on Instagram and Facebook [?][?][?][2][3][4]. One English-language comment frames the data center energy-cost targeting as a permanent fixture of geopolitical influence operations [5], which is a modest analytical extension but not a new development. The @mikenov Ukraine disinformation posts are noise unrelated to the thread's core story. No new substantive claims, voices, or events have emerged; the thread is cooling.

What

Two PRC-linked ChatGPT account clusters — 'Data Center Bandwagon' and 'Tech and Tariffs' — were identified and banned by OpenAI in early June 2026 for generating covert social media content targeting US debates over AI infrastructure costs and trade tariffs [1]. Separately, Estonia's Language Institute and civil defense collective Propastop published a benchmark ranking major commercial LLMs on resistance to 14 categories of Russian strategic narratives, tested in three languages with adversarial prompts [6]. OpenAI assessed that neither PRC campaign achieved measurable public opinion impact beyond its own generated content [1]. The Center for Foreign Interference Research has documented record global proliferation of state-sponsored AI disinformation operations during 2026 [7].

Why it matters

AI infrastructure is now itself a subject of foreign influence operations, not just a medium for them — the PRC campaigns explicitly targeted public narratives about US data centers and energy costs [1]. Estonia's benchmark treats LLM propaganda resistance as a measurable, auditable property rather than a matter of trust in developer self-reporting alone [6], a posture other governments may consider adopting as the broader record of state-sponsored AI disinformation activity in 2026 grows [7].

Open questions

  • Detection and measurement of both PRC campaigns were performed by the targeted platform itself [1]. What independent verification mechanisms exist to assess whether AI-generated influence content reached audiences before disruption?

  • The Estonian benchmark uses an AI judge calibrated to volunteer defense experts [6]. How well does that methodology transfer to other languages and geopolitical contexts without an equivalent expert network?

  • The 'Tech and Tariffs' operation explicitly instructed the model to exclude Xi Jinping from outputs [1]. Does this indicate operators have developed reliable prompt-engineering workarounds for model safety constraints, or that more direct requests remain effectively blocked?

  • Which state actors beyond the PRC are driving the record proliferation of AI-assisted disinformation in 2026 [7], and does the growth reflect new capabilities or scaled use of existing ones?

Narrative

In early June 2026, two parallel developments showed AI models being used as instruments of and potential resistors to foreign state influence activity.

On June 10, OpenAI published a threat intelligence report disclosing that it had identified and banned two clusters of ChatGPT accounts linked to PRC-origin operators [1]. The first cluster, labeled 'Data Center Bandwagon,' generated social media content falsely claiming that AI data center construction was raising electricity costs for ordinary families. The second, 'Tech and Tariffs,' produced content criticizing US trade tariffs while explicitly instructing the model to avoid mentioning Xi Jinping and to center criticism on President Trump. OpenAI assessed that neither operation achieved measurable public opinion impact beyond its own generated activity, and framed public disclosure as a responsibility to help governments, industry, and civil society identify future attempts. The campaigns targeted domestic political debate over US AI infrastructure — framed by OpenAI as a foundation of US technological and economic position. Social media commentary in English, Chinese, and Japanese amplified the disclosure in the days following, with English-language accounts emphasizing the tariff and data center targeting angles [2][3][4][5].

Six days earlier, on June 4, Estonia's Language Institute (EKI) and the volunteer civil defense collective Propastop published a benchmark ranking major commercial LLMs on their resistance to Russian propaganda [6]. The benchmark covers 14 categories of Russian strategic narratives — including justifications for the war in Ukraine, denial of Soviet occupation of the Baltic states, and historical framings of NATO — and was administered in English, Estonian, and Russian. Model responses were scored by a separate AI judge calibrated against assessments from Propastop's expert volunteers. Tests ranged from neutral control questions to questions embedding propaganda assumptions to adversarial prompts specifically designed to elicit explicit misinformation.

The broader context for both developments is a documented expansion of state-sponsored AI disinformation activity globally. The Center for Foreign Interference Research has reported record proliferation of such operations in 2026 [7], suggesting the PRC campaigns OpenAI disrupted represent one visible instance of a wider pattern. OpenAI's approach relies on the platform to detect and publicly disclose misuse after the fact; Estonia's approach attempts to measure model vulnerability before deployment in adversarial conditions. The two postures are complementary but rest on different assumptions about who bears responsibility for auditing this risk.

Timeline

  • 2026-06-04: Estonian Language Institute and Propastop publish a benchmark ranking major LLMs on resistance to 14 categories of Russian propaganda narratives, tested in English, Estonian, and Russian with adversarial prompts. [6][8]
  • 2026-06-10: OpenAI publishes a threat report disclosing two PRC-linked ChatGPT account clusters — 'Data Center Bandwagon' and 'Tech and Tariffs' — that generated covert influence content targeting US AI infrastructure and trade debates; both clusters were banned. [1]
  • 2026-06-10: Social media amplification of the OpenAI PRC disclosure begins across English, Chinese, and multilingual accounts; no new substantive claims emerge beyond the original report. [11][14][15][10]
  • 2026-06-11: Japanese- and Chinese-language social media accounts amplify the OpenAI PRC disclosure; English commentary frames the data center energy-cost targeting as a new norm for geopolitical influence operations. [2][3][4][5]
  • 2026-06-14: CyberScoop, TaiwanPlus, and other outlets publish follow-on coverage of the OpenAI PRC influence operation disclosure, adding no new factual claims. [12][13][16]
  • 2026-06-16: Center for Foreign Interference Research publishes a report documenting record global proliferation of state-sponsored AI disinformation operations during 2026. [7]

Perspectives

OpenAI

Frames proactive public disclosure of disrupted influence operations as a public-interest responsibility; argues neither detected PRC-linked campaign achieved meaningful public opinion impact, implying its detection and banning procedures are functioning.

Evolution: Consistent with prior OpenAI threat reporting posture; this report extends that pattern to PRC operations specifically targeting AI policy and infrastructure debates.

Estonian Language Institute (EKI) / Propastop

Treats LLM propaganda resistance as a government-relevant, measurable property; published a publicly ranked benchmark to give policymakers and the public comparative data on commercial model behavior under Russian narrative pressure.

Evolution: Consistent with Estonia's existing civil information defense infrastructure; this benchmark formalizes that tradition into AI model evaluation.

Center for Foreign Interference Research

Documents state-sponsored AI disinformation as a global, growing phenomenon in 2026, framing the PRC and other campaigns as part of a broader pattern of record proliferation.

Evolution: Consistent; provides a global-trend frame that extends beyond the specific PRC-OpenAI and Estonia-Russia storylines.

Ars Technica (Kyle Orland)

Reports the Estonian benchmark as a legitimate government-sponsored response to real state concerns about LLM-amplified foreign propaganda, without editorializing on which models performed best or worst.

Evolution: Consistent neutral-descriptive stance.

Social media commentators (English, Chinese, Japanese)

Amplify the OpenAI PRC disclosure primarily as evidence of Chinese interference in US domestic politics, with English-language accounts emphasizing the data center and tariff targeting angle.

Evolution: Amplification has broadened to multilingual audiences across platforms, but no novel analytical framing has emerged across multiple waves.

Tensions

  • OpenAI's self-policing posture — detect, ban, and disclose — implies its internal controls are the appropriate first line of defense against AI-enabled influence operations [1]; Estonia's external benchmarking posture implies that commercial LLM developers cannot be solely trusted to assess or report their own models' vulnerability to propaganda amplification [6]. [1][6]
  • OpenAI treats the absence of measurable public opinion impact as evidence that disrupted PRC campaigns were contained [1]; the Estonian study's finding that models remain vulnerable to adversarial propaganda prompts [6] suggests the more pertinent risk is content generation capacity, not campaign-level outcome measurement. [1][6]

Status: cooling down

Sources

  1. [1] PRC-linked influence operations are targeting AI debates in the US — OpenAI Blog (2026-06-10)
  2. [2] 2026年6月10日,OpenAI 全球事务团队发布报告《PRC-linked influence operations are targeting AI debates in the US》,披露并封禁了两组“可能源自中国”的 ChatG... — reactive:ai-foreign-disinfo-operations (2026-06-12)
  3. [3] OpenAIは2026年6月10日、米国のAI関連議論を標的にしたPRC-linked influence operationsについて報告しました。 — reactive:ai-foreign-disinfo-operations (2026-06-11)
  4. [4] 中国系とみられる影響工作がChatGPTを悪用し米国のAI政策論争に潜入していたとOpenAIが報告。 — reactive:ai-foreign-disinfo-operations (2026-06-11)
  5. [5] Geopolitical influence campaigns targeting utility bills to slow down AI data center builds are the new reality of tech ... — reactive:ai-foreign-disinfo-operations (2026-06-11)
  6. [6] These LLMs are the best at resisting Russian propaganda — Ars Technica AI (2026-06-04)
  7. [7] State-Sponsored AI Disinformation Operations Document Record Global Proliferation During 2026 - Center for Foreign Interference Research — reactive:ai-foreign-disinfo-operations
  8. [8] EKI and Propastop Studied AI Resistance to Propaganda – Propastop — reactive:ai-foreign-disinfo-operations
  9. [9] #China is running a covert influence campaign to PREVENT the development of U.S. #datacenters needed for #AI artificial ... — reactive:ai-foreign-disinfo-operations (2026-06-13)
  10. [10] Chinese propagandists have been using ChatGPT to stoke opposition to Donald Trump's tariffs and influence American debat... — reactive:ai-foreign-disinfo-operations (2026-06-12)
  11. [11] A China-linked network tried to use ChatGPT to stoke American anger at data centers and tariff policy. The operation sco... — reactive:ai-foreign-disinfo-operations (2026-06-10)
  12. [12] OpenAI: 'Likely' Chinese influence operation tried to use ChatGPT to ... — reactive:ai-foreign-disinfo-operations
  13. [13] OpenAI Accuses China of Using ChatGPT for Influence Operations - TaiwanPlus — reactive:ai-foreign-disinfo-operations
  14. [14] OpenAI shut down two clusters of ChatGPT accounts they claim likely originated from China after they “used our models in... — reactive:ai-foreign-disinfo-operations (2026-06-10)
  15. [15] OpenAI published a threat intelligence report on June 10 disclosing it had banned 2 ChatGPT account clusters linked to C... — reactive:ai-foreign-disinfo-operations (2026-06-11)
  16. [16] OpenAI says ChatGPT helped uncover Chinese influence operation targeting dissidents — reactive:ai-foreign-disinfo-operations