Share your thoughts, 1 month free Claude Pro on usSee more

Medical Question Answering on HeadQA

92.2Accuracy

Zero-Shot CoT

Updated 1mo ago

Evaluation Results

Method
Zero-Shot CoT 2025.11	92.2	-	-
MIPROv2 2025.11	92.2	-	-
BFRS 2025.11	92	-	-
HELM Baseline 2025.11	91.2	-	-
BFRS 2025.11	91.1	-	-
MIPROv2 2025.11	91.1	-	-
Zero-Shot Predict 2025.11	90.9	-	-
Zero-Shot CoT 2025.11	90.7	-	-
HELM Baseline 2025.11	90.6	-	-
BFRS 2025.11	90.1	-	-
Zero-Shot CoT 2025.11	90	-	-
MIPROv2 2025.11	89.5	-	-
MIPROv2 2025.11	89.5	-	-
HELM Baseline 2025.11	89.3	-	-
Zero-Shot CoT 2025.11	89.3	-	-
BFRS 2025.11	88.9	-	-
Zero-Shot Predict 2025.11	88.7	-	-
Zero-Shot Predict 2025.11	88.5	-	-
HELM Baseline 2025.11	88	-	-
Zero-Shot Predict 2025.11	86.4	-	-
BFRS 2025.11	86.2	-	-
MIPROv2 2025.11	86.2	-	-
Peer-reviewd reasoning 2026.06	86.07	81.56	81.3
Zero-Shot CoT 2025.11	85.9	-	-
Peer-reviewd reasoning 2026.06	85.66	81.15	80.6
Peer-reviewd reasoning 2026.06	85.66	81.15	80.6
Peer-reviewd reasoning 2026.06	85.66	81.15	80.9
Peer-reviewd reasoning 2026.06	85.66	81.15	81
Peer-reviewd reasoning 2026.06	85.66	81.15	82
HELM Baseline 2025.11	85.4	-	-
Peer-reviewd reasoning 2026.06	85.25	80.74	81.2
Peer-reviewd reasoning 2026.06	85.25	80.74	81.4
Peer-reviewd reasoning 2026.06	84.84	80.33	80.7
Peer-reviewd reasoning 2026.06	84.84	80.33	81.6
COT-based group voting 2026.06	84.43	79.92	78.8
COT-based group voting 2026.06	84.02	79.1	76.7
Chain-of-thought 2026.06	83.61	78.69	77.7
Peer-reviewd reasoning 2026.06	83.61	78.69	79
Peer-reviewd reasoning 2026.06	83.61	78.69	79.1
Peer-reviewd reasoning 2026.06	83.61	78.69	79.5
Peer-reviewd reasoning 2026.06	83.61	78.69	79.9
Peer-reviewd reasoning 2026.06	83.2	78.28	78.3
COT-based group voting 2026.06	82.79	77.87	77.7
BFRS 2025.11	82.5	-	-
MIPROv2 2025.11	82.5	-	-
Chain-of-thought 2026.06	81.97	77.05	76.2
COT-based group voting 2026.06	81.97	77.05	76.5
Zero-Shot Predict 2025.11	81.7	-	-
COT-based group voting 2026.06	81.56	76.64	76.4
COT-based group voting 2026.06	81.15	76.23	75.4
COT-based group voting 2026.06	81.15	76.23	75.9
COT-based group voting 2026.06	81.15	76.23	76.1
Zero-Shot CoT 2025.11	80.9	-	-
COT-based group voting 2026.06	80.33	75.41	74.6
COT-based group voting 2026.06	79.92	74.59	74.3
COT-based group voting 2026.06	79.51	74.18	73.2
COT-based group voting 2026.06	79.51	74.18	73.7
COT-based group voting 2026.06	78.69	73.36	74.4
COT-based group voting 2026.06	77.87	72.54	72.2
COT-based group voting 2026.06	77.87	72.54	72.8
Zero-Shot Predict 2025.11	76.9	-	-
HELM Baseline 2025.11	76.7	-	-
Chain-of-thought 2026.06	72.13	66.39	71.1
Chain-of-thought 2026.06	70.9	65.16	65
Chain-of-thought 2026.06	43.03	36.89	43.7