OpenAI

GeneBench-Pro: Multistage Statistical Reasoning in Genomics & Biology

OpenAI's June 2026 benchmark for scientific 'research taste': 129 synthetic genomics / quantitative-biology / translational-medicine problems, each pairing a noisy dataset with a target estimand, graded deterministically from a known causal structure. Extremely hard and unsaturated.

genomicsquantitative-biologytranslational-medicinetabulartext
Status
curated
Saturation
unsaturated
Reproduction
not yet
Published results
6 results

Editor's note

OpenAI's June 2026 benchmark for scientific 'research taste': 129 synthetic genomics / quantitative-biology / translational-medicine problems, each pairing a noisy dataset with a target estimand, graded deterministically from a known causal structure. Extremely hard and unsaturated.

Published results

Results are separated by evaluation version and source configuration. Scores in different sets are not a single comparable ranking.

Pro v13 · OpenAI report

Pro v13 results are separate from the June 2026 original report. Values follow the current primary report, not a secondary catalog. Task counts, answer-format validity and uncertainty are not inferred.

ModelScoreVariantSource
GPT-6 Astra37.1% reported scoreBest reported effortOpenAI · GPT-6 Astra report
Science and Health table; footnote 12
GPT-5.6 Sol32.3% reported scoreBest reported effortOpenAI · GPT-6 Astra report
Science and Health table; footnote 12

Original paper results

ModelScoreVariantSource
GPT-5.6 Sol Pro31.5% accuracymax reasoningOpenAI — GeneBench-Pro report
2026-06-30
GPT-5.6 Sol28.7% accuracydefaultOpenAI — GeneBench-Pro report
2026-06-30
Claude Opus 4.816.0% accuracydefaultOpenAI — GeneBench-Pro report
2026-06-30
Gemini 3.5 Flash8.1% accuracydefaultOpenAI — GeneBench-Pro report
2026-06-30

Sources

  • external OpenAI · GPT-6 Astra report
  • paper OpenAI — GeneBench-Pro report