Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Spoken Question Answering on OpenAudioBench S2T
Loading...
88.89
AlpacaEval Score
Fun-Audio-Chat-30B-A3B
74.8916
78.5258
82.16
85.7942
Dec 23, 2025
AlpacaEval Score
Llama Q. Score
Reasoning QA Accuracy
TriviaQA Accuracy
Web Q. Accuracy
Overall Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
AlpacaEval Score
Llama Q. Score
Reasoning QA Accuracy
TriviaQA Accuracy
Web Q. Accuracy
Overall Score
Fun-Audio-Chat-30B-A3B
LLM Size=30B-A3B, Fram...
2025.12
88.89
85
75.25
76
77.8
80.59
GPT-Audio
2025.12
83.37
90.67
74.75
92.2
83.7
84.94
Gemini-2.5-Pro
2025.12
76.58
83
80.3
90.2
80.9
82.2
Longcat-Flash-Omni-Instruct
LLM Size=560B-A27B, Fr...
2025.12
75.43
83.33
79.71
86.2
76
80.13
Feedback
Search any
task
Search any
task