Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Safety Evaluation on AudioJailBench (AJB) (test)
Loading...
49.6
ASR Accuracy (Audio)
Base
4.88
16.49
28.1
39.71
May 18, 2026
ASR Accuracy (Audio)
Updated 2mo ago
Evaluation Results
Method
Method
Links
ASR Accuracy (Audio)
Base
Backbone=Qwen2.5-Omni-3B
2026.05
49.6
Base
Backbone=MiniCPM-o-4.5
2026.05
45.6
SPA-VL-DPO
Backbone=Qwen2.5-Omni-3B
2026.05
31.8
Base
Backbone=Qwen3-Omni-30...
2026.05
26.4
ShiftDC
Backbone=Qwen2.5-Omni-3B
2026.05
22.2
VLGuard-SFT
Backbone=Qwen2.5-Omni-3B
2026.05
20.8
ShiftDC
Backbone=Qwen3-Omni-30...
2026.05
18.2
ReGap
Backbone=Qwen2.5-Omni-3B
2026.05
17
ReGap
Backbone=Qwen3-Omni-30...
2026.05
16.9
ReGap
Backbone=MiniCPM-o-4.5
2026.05
9.2
ShiftDC
Backbone=MiniCPM-o-4.5
2026.05
6.6
Feedback
Search any
task
Search any
task
