Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on MedQA (EM Accuracy Only)

55.6EM Accuracy

ProMed(S#1+2)

Updated 1mo ago

Evaluation Results

Method	Links
ProMed(S#1+2) 2025.08		55.6
ProMed(S#1)+GRPO 2025.08		54.6
ProMed(S#1)+DPO 2025.08		52.8
ProMed(S#1) 2025.08		52.63
SFT 2025.08		49.39
SFT-GT 2025.08		48.74
Direct 2025.08		48.32
ProMed(S#1+2) 2025.08		47.38
ProMed(S#1)+GRPO 2025.08		46.32
MEDIQ 2025.08		44.78
ProMed(S#1) 2025.08		43.69
ProMed(S#1)+DPO 2025.08		43.44
CoT 2025.08		43.12
SFT-GT 2025.08		42.76
MCTS-MV 2025.08		42.5
SFT 2025.08		41.83
Vanilla 2025.08		40.11
ProMed(S#1+2) 2025.08		39.93
ProMed(S#1)+DPO 2025.08		38.06
ProMed(S#1)+GRPO 2025.08		37.62
ProMed(S#1) 2025.08		37.61
MEDIQ 2025.08		37.13
UoT 2025.08		36.94
SFT 2025.08		36.85
UoT 2025.08		36.71
UoT 2025.08		36.68
Direct 2025.08		36.34
MEDIQ 2025.08		35.73
CoT 2025.08		35.61
MCTS-BT 2025.08		34.41
SFT-GT 2025.08		33.49
DialogT 2025.08		33.42
MCTS-MV 2025.08		33.39
Vanilla 2025.08		31.05
Vanilla 2025.08		30.81
MCTS-MV 2025.08		30.64
MCTS-BT 2025.08		30.24
MCTS-BT 2025.08		29.77
CoT 2025.08		29.54
DialogT 2025.08		28.83
DialogT 2025.08		28.54
Direct 2025.08		27.48