Share your thoughts, 1 month free Claude Pro on usSee more

Medical Question Answering on PubMedQA

86Pass@1

MedXIAOHE

Updated 6d ago

Evaluation Results

Method	Links
MedXIAOHE 2026.02		86
Gemini 3.0 Pro 2026.02		80.8
GPT-5.2 Thinking 2026.02		79.8
Gemini 2.5 Pro 2026.02		75.6
SHIFT 2026.05		74.2
SC-Entropy 2026.05		72.4
SC-Entropy 2026.05		71.6
CoT Similarity 2026.05		71.4
Cluster 2026.05		71
CoT Similarity 2026.05		71
SHIFT 2026.05		70.8
Random (avg) 2026.05		70.72
Random (avg) 2026.05		70.56
CoreSet 2026.05		70.4
Q-PPL 2026.05		70
Qwen3-1.7B 2026.05		69.6
Q-PPL 2026.05		69.6
A-PPL 2026.05		69.2
A-PPL 2026.05		69
Cluster 2026.05		69
CoreSet 2026.05		68.6
Qwen3-1.7B 2026.05		66.2
Qwen2.5-7B + GRPO w/ VERL. 2025.09		47.8
Qwen2.5-7B + GRPO 2025.09		46.6
Qwen2.5-7B + PPO 2025.09		45.8
Qwen2.5-7B + PPO w/ VERL. 2025.09		45.4
Qwen2.5-7B 2025.09		43.6
Mathstral-7B-v0.1 + GRPO w/ VERL. 2025.09		24.4
Mathstral-7B-v0.1 + PPO 2025.09		23.1
Mathstral-7B-v0.1 + GRPO 2025.09		22.6
Mathstral-7B-v0.1 2025.09		22.4
Mathstral-7B-v0.1 + PPO w/ VERL. 2025.09		22.3