Safety Evaluation on MM-SafetyBench
0Average ASR
RAI
Updated 4d ago
Evaluation Results
| Method | Links | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.02 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | - | - | |
2025.12 | 0.03 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 0.12 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 0.12 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 1.7 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 2.24 | 0.31 | 0.62 | 0.93 | 0 | 4.77 | 2.73 | 2.75 | 4.13 | 6.61 | 0.73 | 1.2 | 1.47 | 3.33 | 4.58 | 3.96 | 0.39 | 0.48 | 1.36 | - | - | |
2026.02 | 3.36 | 0.46 | 0.93 | 1.39 | 0 | 7.16 | 4.09 | 4.13 | 6.19 | 9.91 | 1.1 | 1.8 | 2.21 | 5 | 6.88 | 5.94 | 0.59 | 0.72 | 2.05 | - | - | |
2026.02 | 3.62 | 0 | 0 | 10.36 | 0 | 12.8 | 3 | 2.45 | 7.25 | 2 | 0 | 11.2 | 0.33 | 4.15 | 0 | 6.83 | 0.65 | 0.21 | 3.97 | - | - | |
2026.02 | 4.32 | 2.05 | 6.28 | 7.1 | 0.35 | 7.65 | 4.52 | 0.56 | 3.65 | 2.81 | 1.22 | 5.73 | 3.94 | 2.76 | 7.01 | 6.69 | 1.59 | 7.65 | 6.26 | - | - | |
2026.02 | 6.73 | 0.93 | 1.85 | 2.78 | 0 | 14.32 | 8.18 | 8.25 | 12.38 | 19.82 | 2.21 | 3.6 | 4.42 | 10 | 13.75 | 11.87 | 1.17 | 1.43 | 4.09 | - | - | |
2026.02 | 6.88 | 0.95 | 1.9 | 2.84 | 0 | 14.64 | 8.36 | 8.44 | 12.66 | 20.26 | 2.25 | 3.68 | 4.52 | 10.22 | 14.06 | 12.13 | 1.2 | 1.46 | 4.19 | - | - | |
2025.12 | 7.2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 7.47 | 1.03 | 2.06 | 3.09 | 0 | 15.91 | 9.09 | 9.17 | 13.76 | 22.02 | 2.45 | 4 | 4.91 | 11.11 | 15.28 | 13.19 | 1.3 | 1.59 | 4.55 | - | - | |
2026.02 | 8.48 | 4.02 | 12.31 | 13.92 | 0.68 | 15 | 8.87 | 1.1 | 7.16 | 5.5 | 2.39 | 11.23 | 7.73 | 5.42 | 13.75 | 13.12 | 3.12 | 15 | 12.27 | - | - | |
2025.12 | 9.82 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 12.72 | 6.03 | 18.47 | 20.88 | 1.02 | 22.5 | 13.3 | 1.65 | 10.73 | 8.26 | 3.59 | 16.84 | 11.6 | 8.13 | 20.62 | 19.69 | 4.68 | 22.5 | 18.41 | - | - | |
2026.02 | 14.83 | 8.66 | 21.96 | 21.96 | 4.77 | 21.14 | 20.45 | 2.48 | 15.41 | 11.56 | 5.34 | 18.04 | 15.46 | 8.33 | 21.25 | 20.21 | 6.43 | 21.82 | 21.62 | - | - | |
2026.01 | 17.26 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 56.01 | 71.23 | |
2026.02 | 22.24 | 12.99 | 32.94 | 32.94 | 7.16 | 31.7 | 30.68 | 3.72 | 23.12 | 17.34 | 8.01 | 27.05 | 23.19 | 12.5 | 31.87 | 30.31 | 9.64 | 32.73 | 32.44 | - | - | |
2026.02 | 25.43 | 12.06 | 36.94 | 41.75 | 2.04 | 45 | 26.6 | 3.3 | 21.47 | 16.52 | 7.18 | 33.68 | 23.19 | 16.25 | 41.25 | 39.38 | 9.35 | 45 | 36.82 | - | - | |
2026.02 | 26 | 12.33 | 37.76 | 42.68 | 2.09 | 46 | 27.19 | 3.38 | 21.94 | 16.88 | 7.34 | 34.43 | 23.71 | 16.62 | 42.16 | 40.25 | 9.56 | 46 | 37.64 | - | - | |
2026.01 | 27.56 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 44.87 | 53.68 | |
2026.02 | 28.26 | 13.4 | 41.04 | 46.39 | 2.27 | 50 | 29.55 | 3.67 | 23.85 | 18.35 | 7.98 | 37.42 | 25.77 | 18.06 | 45.83 | 43.75 | 10.39 | 50 | 40.91 | - | - | |
2026.01 | 31.01 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 53.68 | 61.72 | |
2026.01 | 32.2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 4.4 | 9.2 | |
2025.12 | 36.01 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.01 | 38.21 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 37.71 | 64.14 | |
2025.12 | 39.82 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 41.52 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.01 | 41.79 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 47.61 | 53.24 | |
2026.01 | 43.33 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 74.05 | 73.2 | |
2026.01 | 44.17 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 9.25 | 20.05 | |
2026.02 | 44.48 | 25.98 | 65.88 | 65.88 | 14.32 | 63.41 | 61.36 | 7.43 | 46.24 | 34.68 | 16.01 | 54.11 | 46.38 | 25 | 63.75 | 60.62 | 19.29 | 65.46 | 64.87 | - | - | |
2026.02 | 45.47 | 26.56 | 67.34 | 67.34 | 14.64 | 64.81 | 62.73 | 7.6 | 47.27 | 35.45 | 16.37 | 55.31 | 47.41 | 25.56 | 65.16 | 61.97 | 19.72 | 66.91 | 66.31 | - | - | |
2025.12 | 45.83 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.01 | 48.21 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 55.03 | 59.72 | |
2026.01 | 48.63 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 50 | 50 | |
2026.02 | 49.42 | 28.87 | 73.2 | 73.2 | 15.91 | 70.45 | 68.18 | 8.26 | 51.38 | 38.53 | 17.79 | 60.12 | 51.53 | 27.78 | 70.83 | 67.36 | 21.43 | 72.73 | 72.08 | - | - | |
2026.01 | 61.9 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 50 | 50 | |
2026.01 | 62.08 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 45.72 | 47.46 | |
2026.01 | 97.3 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.01 | 99.6 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |