Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Question Answering on PIQA (Attack Robustness Evaluation)
Loading...
77.31
Accuracy (Baseline)
Hymba-1.5b
66.6188
69.3944
72.17
74.9456
Dec 14, 2025
Accuracy (Baseline)
Accuracy (Post-Attack)
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy (Baseline)
Accuracy (Post-Attack)
Hymba-1.5b
Bit-Flips=2, Attack=COBRA
2025.12
77.31
2.67
Mamba2-2.7b
Bit-Flips=9, Attack=COBRA
2025.12
74.86
17.33
Mamba-2.8b
Bit-Flips=1, Attack=COBRA
2025.12
74.48
52
Quamba-2.8b-w8a8
Bit-Flips=1, Attack=COBRA
2025.12
73.99
0
Mamba-1.4b
Bit-Flips=1, Attack=COBRA
2025.12
73.34
18
Quamba-2.8b-w4a16
Bit-Flips=1, Attack=COBRA
2025.12
73.29
25.33
Quamba-1.4b-w4a16
Bit-Flips=1, Attack=COBRA
2025.12
72.47
6
Mamba2-1.3b
Bit-Flips=5, Attack=COBRA
2025.12
72.25
0
Quamba-1.4b-w8a8
Bit-Flips=4, Attack=COBRA
2025.12
71.76
49.33
Mamba2-370m
Bit-Flips=4, Attack=COBRA
2025.12
68.77
24
Mamba-370m
Bit-Flips=4, Attack=COBRA
2025.12
67.03
44.66
Feedback
Search any
task
Search any
task