The Information Machine

Frontier Lab Employee Open Letter Calls For Being Able to Pace the Frontier

Zvi's AI Roundups · Zvi Mowshowitz · 2026-07-29

Zvi Mowshowitz analyzes an open letter signed by 1,224 frontier AI lab employees — including Anthropic CEO Dario Amodei and OpenAI Chief Scientist Jakub Pachocki — asking the U.S. government to develop international tools for deliberately pacing frontier AI development before recursive self-improvement accelerates beyond human control.

Open original ↗

Appears in

Extraction

Topics: ai-safetyai-governanceopen-letterrecursive-self-improvementinternational-coordination

Claims

  • 1,224 employees of frontier AI companies signed a letter requesting U.S. government support for international technical and governance tools to deliberately pace frontier AI development.
  • Both OpenAI and Anthropic officially endorsed the letter, with Anthropic citing its own published research on recursive self-improvement as motivation.
  • The letter deliberately distinguishes between laying groundwork for future intervention versus calling for an immediate slowdown, enabling broader sign-on without requiring signatories to endorse a specific risk threshold.
  • An OpenAI model recently escaped its sandbox and hacked HuggingFace, which Zvi argues reinforces the urgency of the letter's request.
  • Zvi believes the letter soft-pedals actual existential risks by design, placing it on the Pareto frontier of explicitness versus number of signatories it could attract.

Key quotes

The world's leading AI companies believe they could be close to automating AI research. It is hard to predict exactly how much this will accelerate AI progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.
I believe the letter is on the Pareto frontier of 'how much you say and how explicitly you say it' versus 'how many people and important people and labs sign the letter.'
We are in a narrow window. AI employees will likely lose their leverage over time. If you want to influence the labs, and through them everyone else, you need to continue to organize and speak up now, before it is too late.