Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on HeadQA

93.4Accuracy

DeepSeek-R1

Updated 22d ago

Evaluation Results

Method	Links
DeepSeek-R1 2026.07		93.4
Claude Sonnet 4.5 2026.07		91
FaithMed (Qwen3 4B) 2026.07		85.7
Agentic Search + GRPO (Qwen3 4B) 2026.07		84.4
MedGemma 27B 2026.07		84
MedRAG (Qwen3 4B) 2026.07		83.9
Qwen3 8B 2026.07		83.4
Agentic Search (Qwen3 4B) 2026.07		81.5
Base (Qwen3 4B) 2026.07		81.3
Attribution 2026.04		80.56
Diversity 2026.04		80.45
Diversity 2026.04		80.38
All 2026.04		80.23
EVOSELECT 2026.04		80.2
EVOSELECT 2026.04		80.16
EVOSELECT 2026.04		80.05
Attr-Div 2026.04		80.05
Diversity 2026.04		80.01
EVOSELECT 2026.04		79.98
Random 2026.04		79.94
Attribution 2026.04		79.94
Attribution 2026.04		79.94
TSDS 2026.04		79.91
Attr-Div 2026.04		79.87
Attr-Div 2026.04		79.8
Diversity 2026.04		79.76
Attr-Div 2026.04		79.76
Random 2026.04		79.69
Attribution 2026.04		79.69
TSDS 2026.04		79.65
Random 2026.04		79.58
All 2026.04		79.5
TSDS 2026.04		79.5
TSDS 2026.04		79.47
Random 2026.04		79.43
Base 2026.04		78.01
FaithMed (Qwen3 1.7B) 2026.07		75.6
Gemma 3 12B 2026.07		73
Agentic Search + GRPO (Qwen3 1.7B) 2026.07		68.5
Llama 3.1 8B Instruct 2026.07		67.6
MedRAG (Qwen3 1.7B) 2026.07		67.5
Attr-Div 2026.04		66.59
TSDS 2026.04		66.56
All 2026.04		66.52
Attribution 2026.04		66.48
EVOSELECT 2026.04		66.45
EVOSELECT 2026.04		66.41
Attribution 2026.04		66.37
Base (Qwen3 1.7B) 2026.07		66.2
EVOSELECT 2026.04		66.19
Attribution 2026.04		66.08
TSDS 2026.04		66.01
Random 2026.04		65.97
EVOSELECT 2026.04		65.9
Random 2026.04		65.9
Random 2026.04		65.79
TSDS 2026.04		65.75
TSDS 2026.04		65.68
Attr-Div 2026.04		65.68
Attr-Div 2026.04		65.57
Agentic Search (Qwen3 1.7B) 2026.07		65.5
Diversity 2026.04		65.43
Attribution 2026.04		65.32
Diversity 2026.04		65.24
Random 2026.04		65.21
Base 2026.04		65.1
Diversity 2026.04		65.03
Attr-Div 2026.04		64.92
Full FT 2026.04		64.9
All 2026.04		64.77
Diversity 2026.04		64.77
MPT 2026.04		64.4
LoRA 2026.04		62.9
Full FT 2026.04		60.3
MPT 2026.04		59.5
PT 2026.04		58.5
Full FT 2026.04		58.4
LoRA 2026.04		58.1
MPT 2026.04		57.3
LoRA 2026.04		56
PT 2026.04		53.5
PT 2026.04		51.2
OLTQA 2023.05		34.48
UnifiedQA 2023.05		29.14