Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Harmfulness Evaluation on AdvBench-audio Harmful
Loading...
26.35
ASR Score
MDSteer-h2s
-1.054
6.0605
13.175
20.2895
Oct 20, 2025
ASR Score
Updated 26d ago
Evaluation Results
Method
Method
Links
ASR Score
MDSteer-h2s
Model=Qwen2-Audio
2025.10
26.35
MDSteer-c2r
Model=Qwen2-Audio
2025.10
23.46
MDSteer-h2s
Model=Kimi-Audio
2025.10
10.38
RRS
Defense runtime (s)=1145
2025.10
3.27
No Defense
Model=Qwen2-Audio
2025.10
2.88
No Defense
2025.10
2.88
AdaShield
Model=Qwen2-Audio
2025.10
1.15
FSD
Model=Qwen2-Audio
2025.10
0.78
SARSteer
Model=Qwen2-Audio
2025.10
0.58
SARSteer
Defense runtime (s)=266
2025.10
0.58
No Defense
Model=Kimi-Audio
2025.10
0
AdaShield
Model=Kimi-Audio
2025.10
0
FSD
Model=Kimi-Audio
2025.10
0
MDSteer-c2r
Model=Kimi-Audio
2025.10
0
SARSteer
Model=Kimi-Audio
2025.10
0
Feedback
Search any
task
Search any
task