Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Modality Conflict Resolution on ALME
Loading...
71
Text Accuracy
Qwen2-Audio-7B-Instruct
46.04
52.52
59
65.48
Jun 17, 2026
Text Accuracy
Delta (Text - Audio)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Text Accuracy
Delta (Text - Audio)
Qwen2-Audio-7B-Instruct
Condition=Abase => TCF
2026.06
71
0.41
Qwen2-Audio-7B-Instruct
Condition=ACF => Tbase
2026.06
70
0.39
Ultravox v0.6-llama-3.1-8b
Condition=Tbase => ACF
2026.06
66
0.32
Ultravox v0.6-llama-3.1-8b
Condition=ACF => Tbase
2026.06
62
0.25
Ultravox v0.6-llama-3.1-8b
Condition=TCF => Abase
2026.06
61
0.22
Ultravox v0.6-llama-3.1-8b
Condition=Abase => TCF
2026.06
56
0.12
Qwen2-Audio-7B-Instruct
Condition=Tbase => ACF
2026.06
50
0
Qwen2-Audio-7B-Instruct
Condition=TCF => Abase
2026.06
47
-0.05
Feedback
Search any
task
Search any
task