U.S. National Library of Medicine (NIH/NLM)

VQA-RAD: Visual Question Answering for Radiology

VQA-RAD is the first manually constructed VQA dataset in radiology, where clinicians asked naturally occurring questions about radiology images and provided reference answers. It contains 315 radiology images (head CTs/MRIs, chest X-rays, abdominal CTs) with

radiologymedical-imagingimagetext
Status
cataloged
Saturation
partial
Runnable
yes
Cost to run
medium

Editor's note

Clinician-authored visual QA over radiology images — a multimodal medical benchmark. Tests vision-language models, not text-only. Already in inspect_evals.

Results

Verified scores pending — this eval is cataloged; our own inspect_ai reproduction is the next step.

Reproduce: inspect_evals implementation

Sources