University of Pittsburgh

PubMedQA: A Dataset for Biomedical Research Question Answering

Biomedical question answering (QA) dataset collected from PubMed abstracts.

biomedicalliterature-qatext
Status
cataloged
Saturation
unknown
Reproduction
full run
Published results
2 models

Published results

ModelScoreVariantProvenance
Claude Opus 4.577.5% scoreSophon-reportedsophon
Claude Sonnet 4.50.0% scoreSophon-reportedsophon

Reproduce: inspect_evals implementation

Sources