FutureHouse

LAB-Bench2: Improved Benchmark for AI Systems Performing Biology Research

FutureHouse's successor to LAB-Bench: ~1,900 tasks in more realistic research contexts, and markedly harder — model accuracy drops 26–46% across subtasks vs the original. Supersedes LAB-Bench (v1) as the current version.

biology-researchliterature-qatextfigures
Status
cataloged
Saturation
unsaturated
Runnable
no
Cost to run
medium

Editor's note

FutureHouse's successor to LAB-Bench: ~1,900 tasks in more realistic research contexts, and markedly harder — model accuracy drops 26–46% across subtasks vs the original. Supersedes LAB-Bench (v1) as the current version.

Results

Verified scores pending — this eval is cataloged; our own inspect_ai reproduction is the next step.

Sources