MedMCQA
by Pal et al. / IIT Kanpur · open-source · Last verified 2026-03-17
MedMCQA is a large-scale, multi-subject, multiple-choice question dataset from Indian medical entrance exams (AIIMS & NEET-PG). With over 194,000 questions spanning 2,400 healthcare topics, it provides a comprehensive evaluation of medical reasoning breadth.
https://medmcqa.github.io ↗B
B—Above Average
Adoption: B+Quality: AFreshness: BCitations: B+Engagement: F
Specifications
- License
- Apache-2.0
- Pricing
- open-source
- Capabilities
- evaluation, medical-reasoning, multi-subject-qa
- Integrations
- Use Cases
- model-evaluation, medical-ai, multilingual-nlp
- API Available
- No
- Evaluated Models
- gpt-4o, claude-opus-4, gemini-2-5-pro, meditron-70b
- Metrics
- accuracy
- Methodology
- 194,000+ four-option MCQs covering anatomy, physiology, biochemistry, and clinical subjects. Models are evaluated on the held-out test split without access to explanations. Accuracy is computed per subject and macro-averaged.
- Last Run
- 2026-02-01
- Tags
- medical, mcq, indian-medical, usmle, multi-subject
- Added
- 2026-03-17
- Completeness
- 100%
Index Score
65.5Adoption
72
Quality
86
Freshness
68
Citations
78
Engagement
0