Share your thoughts, 1 month free Claude Pro on usSee more

Clinical Question Answering on MedQA

94.2Accuracy

DeepSeek-R1

Updated 22d ago

Evaluation Results

Method	Links
DeepSeek-R1 2026.07		94.2	-
Claude Sonnet 4.5 2026.07		93	-
SAG 2026.02		91.4	7
SAG 2026.02		91	5.4
SAG 2026.02		90.3	6.3
SAG 2026.02		89.6	10.2
SAG 2026.02		86	17.9
SAG 2026.02		84.6	19.7
MedGemma 27B 2026.07		83	-
Single giant LLM 2026.02		82.4	15.1
Single giant LLM 2026.02		81.5	30.7
Qwen3 8B 2026.07		79.4	-
Single giant LLM 2026.02		77.2	19.3
FaithMed (Qwen3 4B) 2026.07		74.8	-
Single giant LLM 2026.02		73.4	18.8
Single giant LLM 2026.02		72	30.9
Agentic Search + GRPO (Qwen3 4B) 2026.07		71.3	-
Agentic Search (Qwen3 4B) 2026.07		70.6	-
MedRAG (Qwen3 4B) 2026.07		70.2	-
Base (Qwen3 4B) 2026.07		69.3	-
Gemma 3 12B 2026.07		69	-
Llama 3.1 8B Instruct 2026.07		61.8	-
FaithMed (Qwen3 1.7B) 2026.07		61.4	-
Single giant LLM 2026.02		59.8	17.4
Me-LLaMA 2026.02		58	26.9
MedRAG (Qwen3 1.7B) 2026.07		51.4	-
Agentic Search + GRPO (Qwen3 1.7B) 2026.07		50.9	-
Agentic Search (Qwen3 1.7B) 2026.07		49.2	-
Base (Qwen3 1.7B) 2026.07		48.9	-
Meditron 2026.02		34.9	28.3