Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Biomedical Question Answering on MedMCQA In-Domain (test)
Loading...
90
Accuracy
Human (expert)
21.672
39.411
57.15
74.889
Aug 18, 2023
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
Human (expert)
Setting=Manual
2023.08
90
BioMedGPT-10B
Setting=Fine-tuning
2023.08
51.4
PMC-Llama
Setting=Fine-tuning
2023.08
50.5
Llama2-Chat
Setting=Fine-tuning
2023.08
48.3
Llama
Setting=Fine-tuning
2023.08
48.2
ChatGPT
Setting=Zero-shot
2023.08
44.7
InstructGPT
Setting=Zero-shot
2023.08
44
Llama2-Chat
Setting=Zero-shot
2023.08
35.5
Llama2
Setting=Zero-shot
2023.08
30.6
Llama
Setting=Zero-shot
2023.08
24.3
Feedback
Search any
task
Search any
task