Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Question Answering on MedMCQA (dev)
Loading...
0.791
Accuracy
GPT-4 (Medprompt)
0.2762
0.40985
0.5435
0.67715
Nov 16, 2022
Mar 14, 2023
Jul 10, 2023
Nov 5, 2023
Mar 2, 2024
Jun 28, 2024
Oct 25, 2024
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
GPT-4 (Medprompt)
Prompting Strategy=Med...
2023.11
0.791
GPT-4o
Prompting (shots)=5-shot
2024.10
0.79
GPT-4o
Prompting (shots)=0-shot
2024.10
0.77
GPT-4
Prompting Strategy=5-s...
2023.11
0.724
Med-PaLM 2
Strategy Selection=cho...
2023.11
0.723
GPT-4T (May 2024)
Prompting (shots)=5-shot
2024.10
0.72
GPT-4T (May 2024)
Prompting (shots)=0-shot
2024.10
0.7
Flan-PaLM 540B
Strategy Selection=cho...
2023.11
0.576
Galactica
Model Size=120B, Shots...
2022.11
0.529
BLOOM
Shots=5, Domain=in-domain
2022.11
0.325
OPT
Shots=5, Domain=in-domain
2022.11
0.296
Feedback
Search any
task
Search any
task