Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Spoken Dialogue Evaluation on Audio MultiChallenge v1 (test)
Loading...
39.33
Semantic Memory Pass Ratio
Qwen3-Omni-30B-A3B-Instruct
12.5292
19.4871
26.445
33.4029
Jun 15, 2026
Semantic Memory Pass Ratio
Self Coherence Pass Ratio
Average Pass Ratio
Updated 1mo ago
Evaluation Results
Method
Method
Links
Semantic Memory Pass Ratio
Self Coherence Pass Ratio
Average Pass Ratio
Qwen3-Omni-30B-A3B-Instruct
CAD=true
2026.06
39.33
38.8
39.08
MiMo-Audio-7B-Instruct
CAD=true
2026.06
32
36.39
34.11
MiMo-Audio-7B-Instruct
CAD=false
2026.06
26
26.02
26.01
Kimi-Audio-7B-Instruct
CAD=true
2026.06
23.11
22.65
22.89
Qwen3-Omni-30B-A3B-Instruct
CAD=false
2026.06
22.67
29.16
25.78
Kimi-Audio-7B-Instruct
CAD=false
2026.06
13.56
19.04
16.19
Feedback
Search any
task
Search any
task