AI Systems Achieve Verifiable Mathematical Reasoning

What

Why it matters

Open questions

• AlphaProof Nexus solved 9 Erdős problems and 44 OEIS conjectures [7][8] — what are the specific problems, how do they compare in difficulty to the OpenAI unit distance disproof, and how has independent verification proceeded?

• AI models went from failing USAMO 2025 to strong performance on USAMO 2026 [14][15]; if competition benchmarks near saturation within a year as Rohan Paul predicts [16], what evaluation frameworks can distinguish degrees of difficulty in research-level AI mathematics?

• Tao's concern about 'mass-produced mathematics at scale' [20] — has the mathematical community or any institution developed a systematic response to review-capacity pressure as systems resolve dozens of conjectures simultaneously?

• DeepMind's CEO explicitly rules out AGI framing for these math achievements [21] — how do researchers distinguish progress in mathematical reasoning from broader general intelligence claims, and does that distinction hold as systems tackle more open-ended research problems?

Narrative

Timeline

• 1946-01-01: Paul Erdős poses the unit distance conjecture in discrete geometry [3]
• 2024-07-01: DeepMind's AlphaProof and AlphaGeometry 2 earn silver medal at IMO 2024 [33]
• 2025-04-01: AI models fail USAMO 2025; performance described as miserable relative to competition standard [14]
• 2025-07-21: NYT reports Google AI wins gold at IMO 2025; OpenAI also claims gold — first AI systems to clear this threshold [1][2][23]
• 2025-08-03: Xena Project publishes mathematical community round-up of AI performance at IMO 2025 [31]
• 2026-02-01: The Atlantic publishes longform profile on how Terence Tao uses AI in his research [24]
• 2026-05-20: OpenAI announces unreleased reasoning model disproved the Erdős unit distance conjecture [3][27]
• 2026-05-21: Gil Kalai acknowledges disproof as 'Amazing'; widespread media amplification including The Guardian [5][34][35]
• 2026-05-22: arXiv preprint on the disproof appears; formal verification debate surfaces in coverage [4][10]
• 2026-05-23: Three Erdős problems fall in seven days with Tao verifying each; Gary Marcus publishes critical review of AI math headlines [19][26]
• 2026-05-24: Tao's GitHub wiki tracking AI contributions confirmed; Tao quoted on 'mass-produced mathematics at scale'; AlphaProof Nexus first mentioned [18][20][36]
• 2026-05-28: Zvi Mowshowitz reports AlphaProof Nexus solved 9 Erdős problems and 44 OEIS conjectures; notes landmark result with almost no mainstream media coverage [8][7]
• 2026-06-01: Ars Technica: Fields Medalist Tim Gowers and Daniel Litt explicitly validate OpenAI's Erdős result as substantively exciting [6]
• 2026-06-04: Google research paper: structured proof-writing raises general LLM formal math performance from under 10% to 70% [12]
• 2026-06-07: Rohan Paul predicts competition math benchmarks near obsolescence; expects a model with a perfect IMO score within one year [16]
• 2026-06-08: Reports confirm AI models that failed USAMO 2025 now perform strongly on USAMO 2026; prediction market opens on perfect IMO 2026 score; DeepMind CEO rules out AGI framing for math achievements [14][15][17][21]

Perspectives

Tensions

• OpenAI's Erdős disproof came from a general-purpose model with no formal-system grounding; DeepMind's architecture requires every reasoning step to be Lean-verified — both have produced expert-validated results, but they represent different claims about what makes AI mathematical output trustworthy. [3][10][11][4][2][23][6]
• Gary Marcus explicitly audits AI math headlines against underlying results [26], while Fields Medalist Tim Gowers and Daniel Litt have directly endorsed the OpenAI Erdős result as substantively exciting [6] — the most direct clash between the skeptical and endorsing positions. [26][6][3]
• Tao observes 'more and more mass-produced mathematics at scale' [20] as a quality concern; Rohan Paul frames high-volume proof-search as precisely the mechanism for mathematical progress and expects benchmark saturation within a year [16] — the same phenomenon read as a problem versus a feature. [20][16][12]
• AlphaProof Nexus solved 9 Erdős problems and 44 OEIS conjectures — results Zvi calls a landmark milestone — but received almost no mainstream coverage [8], while OpenAI's single Erdős disproof generated sustained press attention; the coverage gap does not track the volume of results. [8][7][3][22]
• DeepMind's CEO explicitly rules out AGI framing for the math achievements [21], while Harmonic's Tudor Achim predicts AI could prove the Riemann Hypothesis by 2028 [27] and Rohan Paul expects a perfect IMO score within a year [16] — the producing organization and outside commentators draw opposite conclusions from the same results. [21][27][16]
• The UW Math AI Lab's dataset of erroneous Lean proofs challenges the 'every step formally verified' claim central to DeepMind's and Harmonic's architectures — if the verification layer itself produces false proofs, formal-system grounding may be less reliable than claimed. [13][10][27][11]