Fa et al. (ICML 2026)
BioAgent Bench: AI Agent Evaluation Suite for Bioinformatics
End-to-end bioinformatics pipelines (RNA-seq, variant calling, metagenomics) with a robustness twist: stress-tests agents under corrupted inputs and decoy files, LLM-graded for pipeline progress and outcome validity. Finds frontier agents complete pipelines without heavy scaffolding but break under perturbation. ICML 2026.
bioinformaticsagentic-pipelinescodetabular
Status
cataloged
Saturation
partial
Reproduction
not yet
Published results
0 models
Editor's note
End-to-end bioinformatics pipelines (RNA-seq, variant calling, metagenomics) with a robustness twist: stress-tests agents under corrupted inputs and decoy files, LLM-graded for pipeline progress and outcome validity. Finds frontier agents complete pipelines without heavy scaffolding but break under perturbation. ICML 2026.
Published results
No source-reported scores have been added to BioInspect yet.
Sources
- paper benchmark paper