Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Spoken Medical Question Answering on MMLU (test)
Loading...
95.4
Clinical
MedSpeak
60.872
69.836
78.8
87.764
Feb 1, 2026
Clinical
Anatomy
College
Virology
Professional Medicine
Updated 1mo ago
Evaluation Results
Method
Method
Links
Clinical
Anatomy
College
Virology
Professional Medicine
MedSpeak
Transcription Source=W...
2026.02
95.4
93.3
95.6
95.8
97.8
Fine-Tuned LLM + GT (FT-LLM)
Transcription Source=G...
2026.02
94.3
94.1
92.7
91
94.9
Fine-Tuned LLM + Whisper (FT+Whisp)
Transcription Source=W...
2026.02
85.6
85.2
84.2
85.5
88.6
Zero-shot GT (Zero-Shot)
Transcription Source=G...
2026.02
66.3
64.4
67.5
48.8
76.1
Zero-shot ASR (ZS-ASR)
Transcription Source=W...
2026.02
62.2
57
62.1
47.6
74.6
Feedback
Search any
task
Search any
task