Diks et al. (SpatialBench team)
SpatialBench-Long: Verifiable Long-Horizon Spatial Biology
24 long-horizon spatial biology evaluations spanning CosMx, Visium, Xenium, MERFISH, Slide-seq, histology, and lineage data. The live leaderboard now has GPT-5.6 Sol at 38.9% with Codex and Opus 5 at 25.0% with Pi.
spatial-biologyspatial-transcriptomicslong-horizontabularimagecode
Status
curated
Saturation
unsaturated
Reproduction
not yet
Published results
5 models
Editor's note
24 long-horizon spatial biology evaluations spanning CosMx, Visium, Xenium, MERFISH, Slide-seq, histology, and lineage data. The live leaderboard now has GPT-5.6 Sol at 38.9% with Codex and Opus 5 at 25.0% with Pi.
Published results
| Model | Score | Variant | Provenance |
|---|---|---|---|
| GPT-5.6 Sol | 38.9% pass rate | Codex harness | external |
| Opus 5 | 25.0% pass rate | Pi harness | external |
| Gemini 3.5 Flash | 11.1% pass rate | Pi harness | paper |
| GPT-5.5 | 11.1% pass rate | Pi harness | paper |
| GPT-5.5 | 11.1% pass rate | OpenAI Codex harness | paper |