Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Medical Question Answering on Multilingual Medical Evaluation German (test)
Loading...
4.8
ECE
MedAlpaca 7B
4.272
7.836
11.4
14.964
Feb 15, 2024
ECE
Delta ECE (vs Mistral 7B Instruct)
Updated 4d ago
Evaluation Results
Method
Method
Links
ECE
Delta ECE (vs Mistral 7B Instruct)
MedAlpaca 7B
Parameters=7B
2024.02
4.8
13.2
BioMedGPT-LM-7B
Parameters=7B
2024.02
4.8
13.2
MediTron-7B
Parameters=7B
2024.02
9.7
8.3
PMC-LLAMA 7B
Parameters=7B
2024.02
12.3
5.7
BioMistral 7B
Parameters=7B
2024.02
15.2
2.8
BioMistral 7B SLERP
Merging Strategy=SLERP
2024.02
15.8
2.2
BioMistral 7B DARE
Merging Strategy=DARE
2024.02
16.6
1.4
BioMistral 7B TIES
Merging Strategy=TIES
2024.02
16.9
1.1
Mistral 7B Instruct
Parameters=7B
2024.02
18
-
Feedback
Search any
task
Search any
task