Version 3

OpenAI released GeneBench-Pro on June 30, 2026 — a 129-problem expert computational biology benchmark with synthetically generated problems and deterministic grading. [1] GPT-5.6 Sol scores 31.5% with Pro mode enabled versus below 5% for GPT-5, roughly a six-fold improvement; OpenAI predicts saturation by year-end. [1] No other major lab has published scores, and no independent external validation of the methodology has appeared. Social amplification continues into July 3 but carries no new substantive claims. [11][12][14]

If AI can solve expert genomics problems at several dollars each versus $4,000–8,000 for a human expert [1], the economic case for AI-assisted computational biology is direct. The US-only access restriction on GPT-5.6 [15] means differential access to the highest-capability models may now have practical consequences for genomics research outside institutional channels.

OpenAI released GeneBench-Pro on June 30, 2026, framing it as a research-level evaluation of whether AI systems can handle the multi-step expert reasoning that characterizes graduate-level computational biology. [1] The 129 problems are synthetically generated with fully known causal structures, enabling deterministic grading and preventing models from exploiting ambiguous answer paths that have weakened other long-horizon biology benchmarks. [1] Each question requires sequential reasoning: models must first identify and correct domain-specific data artifacts — ambient RNA contamination, low-mappability genomic contacts, label inversions, and plate effects — before addressing the primary biological question. [2] Problem types span more than ten subfields including lncRNA dependency analysis, cis-multivariable Mendelian randomization, carrier screening, single-cell RNA-seq eQTL modeling, and ancient selection inference. [2]

GPT-5.6 Sol achieves a 31.5% pass rate with Pro mode enabled, compared to below 5% for GPT-5. [1] OpenAI also reports that GPT-5.6 Sol at its highest reasoning level solves nearly six times as many problems as GPT-5.2 while consuming approximately two-thirds the tokens, suggesting test-time compute scaling is delivering large returns in scientific reasoning. [1] Open-source models underperform GPT models on GeneBench-Pro by a wider margin than on coding benchmarks, which OpenAI interprets as evidence of broader scientific reasoning capability beyond code generation alone. [1] Collin Burdick adds historical context: GPT-5.2 was already state-of-the-art on scientific reasoning benchmarks six months before GeneBench-Pro's release, indicating this capability has been accumulating across the GPT-5.x series. [3]

Commentator @ollobrains frames what the benchmark actually tests: GeneBench-Pro is not asking whether an AI knows biology, but whether it can behave like a computational biologist. [4] That framing connects to a parallel argument the same author has been running — that US access restrictions on GPT-5.6 effectively create a sovereign instrument, with major pharmaceutical companies retaining access through institutional channels while independent researchers and non-US institutions cannot rely on restricted models for genomics work. [5][6] The author advocates open-weight alternatives as the only reliable path for global science. [7] OpenAI's own economic framing is direct: human experts require roughly 20–40 hours per problem at approximately $200 per hour, while AI inference costs only several dollars per problem. [1]

GeneBench-Pro's credibility faces a structural challenge common to lab-created benchmarks: OpenAI both designed the evaluation and currently leads it, with no independent external validation of the methodology as of early July 2026. Community leaderboards at LLM Stats and BenchLM.ai have begun tracking results [8][9], and Time magazine covered OpenAI's broader FrontierScience evaluation program. [10] International attention has been broad, with accounts amplifying the announcement in Japanese, Spanish, English, and other languages through July 3 [11][12][13], but the substantive debate remains confined to the access restriction question and the benchmark's validity for real-world genomics work.