Evals by capability
32 bio evaluations, grouped by the capability they probe. Tags come from each eval's bio taxonomy.
Single-cell & spatial omics
5Analyzing single-cell and spatially-resolved biology data.
scBench: A Benchmark for Single-Cell RNA-seq Analysis
curatedSingle-cell RNA-seq analysis. Current Latch V1 (formerly V2), legacy V0 (formerly V1), original-paper results and Anthropic's SingleCellBench evaluation are separate because evaluation sets, scoring and harnesses differ.
4 separate result sets · single-cell, transcriptomics
SpatialBench: Can Agents Analyze Real-World Spatial Biology Data?
catalogedReal-world spatial biology analysis. Current Latch V1 (formerly V2), legacy V0 (formerly V1), paper results and Anthropic's SpatialBench Verified evaluation are separate; matching names do not imply identical configurations.
4 separate result sets · spatial-biology, spatial-transcriptomics
SpatialBench-Long: Verifiable Long-Horizon Spatial Biology
curatedLong-horizon spatial biology research workflows. Current Latch V1 (formerly V2) contains 21 evaluation records; legacy V0 and paper scores remain separate, not directly comparable rankings.
3 separate result sets · spatial-biology, spatial-transcriptomics
scBench-Long: Verifiable Long-Horizon Single-Cell Biology
curatedLong-horizon single-cell research workflows. Current Latch V1 (formerly V2) contains 22 evaluation records; legacy V0 and paper scores remain separate, not directly comparable rankings.
3 separate result sets · single-cell, transcriptomics
EpiBench: Epigenomics Analysis
curatedOfficial current V1 results cover 106 evaluation records. Scores are macro-mean pass rates, not whole-study replication rates.
top: Claude Opus 5.5* · 39.6% · epigenomics
Bioinformatics agents & pipelines
4End-to-end computational-biology workflows.
MetagenomicsBench: Microbial Community Analysis
curatedOfficial current V1 results cover 100 evaluation records. Unreported model scores are omitted, not counted as failures.
top: Claude Opus 5.5* · 62.7% · metagenomics, microbiome
BixBench3: Research-Study-Scale Computational Biology
curatedModels implement study-scale analysis plans and produce artifacts graded against published references. The displayed metric is mean artifact score, not fully reproduced studies. The public runner uses Inspect; dataset access requires separate approval.
top: claude-fable-5.1 (with fallback) · 51.5% · computational-biology, bioinformatics
BixBench
curatedOpen-answer agentic bioinformatics: agents must run multi-step analyses over real datasets. Scores are low and the open-answer vs multiple-choice gap is large, so treat MCQ numbers with skepticism. Best public agents still miss roughly half the questions.
top: Biomni Lab (2026-02-03) · 52.2% · computational-biology, bioinformatics-agents
BioAgent Bench: AI Agent Evaluation Suite for Bioinformatics
catalogedEnd-to-end bioinformatics pipelines (RNA-seq, variant calling, metagenomics) with a robustness twist: stress-tests agents under corrupted inputs and decoy files, LLM-graded for pipeline progress and outcome validity. Finds frontier agents complete pipelines without heavy scaffolding but break under perturbation. ICML 2026.
scores pending · bioinformatics, agentic-pipelines
Genomics & sequence
3Reasoning over genomic and sequence data.
TxBench: Oligonucleotide Discovery
curatedOfficial current V1 results cover 113 evaluation records. Agents make decisions from experimental data without internet access.
top: Claude Opus 5.5* · 62.2% · therapeutics, oligonucleotides
VariantBench: Genetic Variant Discovery and Interpretation
curatedOfficial current V1 results cover 118 evaluation records. Model-and-harness configurations are retained separately.
top: Claude Opus 5 · 52.8% · genomics, variant-analysis
GeneBench-Pro: Multistage Statistical Reasoning in Genomics & Biology
curatedOpenAI's June 2026 benchmark for scientific 'research taste': 129 synthetic genomics / quantitative-biology / translational-medicine problems, each pairing a noisy dataset with a target estimand, graded deterministically from a known causal structure. Extremely hard and unsaturated.
2 separate result sets · genomics, quantitative-biology
Clinical & medical
3Healthcare, medical imaging, and translational tasks.
TxBench: Preclinical Pharmacology
curatedOfficial current V1 results cover 100 evaluation records, including target engagement, safety and disease-model evidence.
top: Claude Opus 5.5* · 65.3% · therapeutics, pharmacology
HealthBench: Evaluating Large Language Models Towards Improved Human Health
catalogedRubric-graded healthcare conversations. Raw and length-adjusted scores, benchmark subsets, and publisher grading setups are shown separately. Anthropic uses an Opus 4.8 grader; its scores are not a controlled comparison with OpenAI-reported scores.
10 separate result sets · clinical, healthcare
VQA-RAD: Visual Question Answering for Radiology
catalogedClinician-authored visual QA over radiology images — a multimodal medical benchmark. Tests vision-language models, not text-only. Already in inspect_evals.
scores pending · radiology, medical-imaging
Molecular & chemical
3Molecular biology and chemistry.
TxBench: Antibody Discovery
curatedOfficial current V1 results cover 100 evaluation records. Evaluates candidate selection, assay evidence and transfer across biological systems.
top: Claude Opus 5.5* · 67.7% · therapeutics, antibody-discovery
BioMysteryBench
curatedAgentic bioinformatics investigations using raw biological data. Vals AI reports overall accuracy across 90 tasks, averaged over three full-benchmark runs; these are external evaluations, not BioInspect runs.
top: Claude Sonnet 5.5 · 81.1% · bioinformatics, molecular-biology
ChemBench: Are large language models superhuman chemists?
catalogedBroad chemistry knowledge and reasoning over 2,786 QA pairs. Chemistry-adjacent to biology (drug discovery, molecular properties); included as a boundary domain. Already in inspect_evals.
scores pending · chemistry, drug-discovery-adjacent
Literature & knowledge
3Biomedical QA and literature synthesis.
LAB-Bench2: Improved Benchmark for AI Systems Performing Biology Research
curatedEdison Scientific's successor to LAB-Bench, covering literature, figures, tables, protocols and biological sequences. Official results are presented per subbenchmark, separating base/tools and input modes. SourceQuality was refreshed in March 2026; these are not the original LAB-Bench ProtocolQA results.
40 separate result sets · biology-research, literature-qa
PubMedQA: A Dataset for Biomedical Research Question Answering
catalogedtop: Claude Opus 4.5 · 77.5% · biomedical, literature-qa
LAB-Bench: Measuring Capabilities of Language Models for Biology Research
catalogedBiology-research QA spanning literature, protocols, figures, and sequences. The published GPT-6.1 result below is OpenAI's ProtocolQA Open-Ended adaptation, not the original LAB-Bench multiple-choice task or a BioInspect run.
top: GPT-6.1 Sol · 40.7% · biology-research, literature-qa
Scientific reasoning & discovery
10Expert reasoning, research workflows, and replication.
LongevityBench: Aging Biology Across Omics Domains
curatedOfficial results cover the site's 26 visible models, including fine-tuned Longevity-LLMs and untuned base/frontier models. Per-task metrics retain native units and direction; scores are not averaged into a BioInspect index. Model training exposure and task-specific scoring should be considered when comparing specialized models with general-purpose models.
17 separate result sets · aging-biology, multiomics
Terminal-Bench Science 0.1 — Life Sciences
curatedtop: GPT-6 Astra (max) · Codex · 59.6% · biology, medicine
BioStudyBench: Post-Cutoff Biomedical Studies
curatedStudy findings from July–September 2026 are scored by reference agreement. Each condition has three repeats; uncertainty is standard deviation, not a confidence interval. Retrieval restrictions and published knowledge cutoffs reduce contamination risk but do not guarantee unseen answers.
2 separate result sets · biomedical, research-workflows
SWE-bench Science — Biology & BME
curatedtop: Claude-Opus-5 (max) · Claude Code · 68.0% · biology, biomedical-engineering
LifeSciBench: Realistic, Expert-Level Life Science Tasks
curatedExpert-authored life-science tasks with rubric-based scoring, designed to capture ambiguity and scientific judgment. The original 750-task preprint scores and OpenAI's later Gold v1 results are separate; a rubric score is not a whole-task pass rate.
2 separate result sets · life-sciences, research-workflows
BiomniBench-DataAnalysis (Biomni-DA-v0)
curatedPreliminary 15-task preview of Phylo's trace-based evaluation for long-horizon biological data analysis. It scores analytical process—including data handling, method selection, statistical rigor, source reliability, and reasoning—rather than only final-answer accuracy. Results are preliminary and the benchmark remains a work in progress.
top: Senior pharmaceutical scientists · 68.5% · biology-research, biomedical-data-analysis
BixBench-Verified-50
curatedPhylo's expert-reviewed 50-task subset of BixBench removes, clarifies, or corrects ambiguous questions and flawed ground truths. Scores are substantially higher than on the full benchmark and must not be treated as directly comparable to full-BixBench results.
top: Biomni Lab (2026-02-03) · 88.7% · computational-biology, bioinformatics-agents
BioMedArena: Toolkit for Biomedical Deep-Research Agents
catalogedLess a single benchmark than an open-source harness aggregating 166 biomedical benchmarks and 75 tools across 9 functional families, decoupling tool exposure / harness mode / context / scoring. Across 12 backbones, tool-equipped agents gain ~15 pts on average over prior SOTA on 8 representative benchmarks. Useful infrastructure to track.
scores pending · biomedical, deep-research
FrontierScience: Expert-Level Scientific Reasoning
catalogedExpert / olympiad-level reasoning across physics, chemistry, and biology (160 problems). Only the biology subset is in-scope for us; unsaturated and hard. Already in inspect_evals.
scores pending · scientific-reasoning, biology-subset
PaperBench: Evaluating AI''s Ability to Replicate AI Research (Work In Progress)
catalogedOpenAI's benchmark for replicating 20 ICML 2024 papers from scratch — not biology per se, but an agentic 'AI for science' boundary benchmark relevant to reproducible research workflows. Long-horizon and expensive to run. Already in inspect_evals.
scores pending · research-replication, agentic-science
Biosecurity & safety
1Dual-use and hazardous-knowledge evaluations.