Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Open-ended Instruction Following on Audio-OpenHermes
Loading...
4.44
EN Score
SEA-LION-v3-8B-IT
3.2336
3.5468
3.86
4.1732
Mar 7, 2026
EN Score
ID Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
EN Score
ID Score
SEA-LION-v3-8B-IT
Approach category=Text...
2026.03
4.44
3.85
Ours (hard-gating)
Approach category=Dist...
2026.03
4.42
3.66
Ours (soft-gating)
Approach category=Dist...
2026.03
4.29
3.58
Whisper-v3 + SEA-LION-v3-8B-IT
Approach category=Casc...
2026.03
4.17
3.61
MERaLiON-2-10B
Approach category=Zero...
2026.03
4.06
3.06
ML-DiVA
Approach category=Dist...
2026.03
4.03
3.11
Glm-4-voice
Approach category=Zero...
2026.03
3.72
-
Qwen2-Audio
Approach category=Zero...
2026.03
3.65
-
SeaLLMs-Audio
Approach category=Zero...
2026.03
3.37
3.27
EN-DiVA
Approach category=Dist...
2026.03
3.28
-
Feedback
Search any
task
Search any
task