Our new X account is live! Follow @wizwand_team for updates

Medical Question Answering on PubMedQA (Accuracy)

81.4Accuracy

HuatuoGPT-o1-70B

Updated 3d ago

Evaluation Results

Method	Links
HuatuoGPT-o1-70B 2025.04		81.4
HuatuoGPT-o1-8B 2025.04		80.1
UltraMedical-70B-3 2025.04		80
HuatuoGPT-o1-72B 2025.04		79.9
OpenBioLLM-70B 2025.04		79.3
UltraMedical-8B-3.1 2025.04		79.2
HuatuoGPT-o1-7B 2025.04		78.6
Med42-70B 2025.04		78.1
m1-32B-1K 2025.04		77.6
MMedS-8B 2025.04		77.5
m1-7B-1K 2025.04		77.5
Med42-8B 2025.04		76
m1-7B-23K 2025.04		75.8
MedLlama3-8B-v2 2025.04		75.5
Qwen2.5-7B-Instruct 2025.04		72.6
Qwen2.5-7B-Instruct 2025.04		71.3
Qwen2.5-72B-Instruct 2025.04		71.3
UltraMedical-8B-3 2025.04		71.1
Qwen2.5-72B-Instruct 2025.04		70.8
OpenBioLLM-8B 2025.04		70.1
Qwen2.5-32B-Instruct 2025.04		68.9
Qwen2.5-32B-Instruct 2025.04		68
MMed-8B-EnIns 2025.04		63.8
MMed-8B 2025.04		63.4
ReFilter 2026.02		56.8
ReFilter 2026.02		56
ReFilter 2026.02		55.2
S-RAG 2026.02		55.2
DyPRAG 2026.02		55.2
DyPRAG 2026.02		54.8
S-RAG 2026.02		54.2
PRAG 2026.02		54
Vanilla 2026.02		54
PRAG 2026.02		54
MedLlama3-8B-v1 2025.04		52.7
Vanilla 2026.02		51.8
PRAG 2026.02		51.8
S-RAG 2026.02		51.6
DyPRAG 2026.02		50
Vanilla 2026.02		49.8
ReFilter 2026.02		35.6
S-RAG 2026.02		35.2
PRAG 2026.02		32
Vanilla 2026.02		30.2
DyPRAG 2026.02		28.4