ICD-Bench Medical Reasoning Quiz

Bhishma Dedhia *

Princeton University

Yuval Kansal *

Princeton University

Niraj K. Jha

Princeton University

*Equal Contribution

About ICD-Bench

The International Classification of Diseases (ICD-10) provides a standardized framework for categorizing medical conditions and diseases worldwide. Our ICD-Bench evaluation suite comprises 3,675 high-quality medical reasoning questions systematically generated from knowledge graph paths. Questions are organized by ICD-10 medical categories with balanced difficulty distribution across 5 progressive difficulty levels.

Difficulty Levels & Medical Categories

Level 1: Very Easy

Basic medical terminology and fundamental concepts

Level 2: Easy

Straightforward medical knowledge and basic clinical reasoning

Level 3: Medium

Intermediate medical concepts requiring clinical correlation

Level 4: Hard

Advanced medical reasoning and complex diagnostic scenarios

Level 5: Very Hard

Expert-level challenges requiring comprehensive medical knowledge

15 ICD-10 Categories

Comprehensive coverage of disease topologies and clinical vignettes

How to Use

1

Select Medical Category

Choose one out of 15 ICD-10 categories (e.g., Behavioral and Neurodevelopmental disorders, Nutritional and metabolic diseases, Neoplasms)

2

Take 10-Question Quiz

Automatically balanced difficulty distribution across 5 levels with randomized question selection

3

Answer Clinical Questions

Multiple choice questions based on realistic medical scenarios

4

Get Enhanced Feedback

Detailed explanations with Knowledge Graph paths and structured QwQ-Med-3 reasoning responses

5

Track Performance

Monitor your score across different difficulty levels and medical specialties


Loading ICD-Bench questions...