Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Word Prediction on Lambada (Robustness Evaluation)
Loading...
82.2
Accuracy (Original)
Hymba-1.5b
53.5688
61.0019
68.435
75.8681
Dec 14, 2025
Accuracy (Original)
Accuracy (Attacked)
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy (Original)
Accuracy (Attacked)
Hymba-1.5b
Bit-Flips=2, Attack=COBRA
2025.12
82.2
30
Mamba-2.8b
Bit-Flips=1, Attack=COBRA
2025.12
78.34
4
Mamba2-2.7b
Bit-Flips=9, Attack=COBRA
2025.12
77.78
15.33
Quamba-2.8b-w8a8
Bit-Flips=1, Attack=COBRA
2025.12
77.55
22
Quamba-2.8b-w4a16
Bit-Flips=1, Attack=COBRA
2025.12
76.03
0
Mamba2-1.3b
Bit-Flips=5, Attack=COBRA
2025.12
75.39
30.67
Mamba-1.4b
Bit-Flips=1, Attack=COBRA
2025.12
74.64
0
Quamba-1.4b-w4a16
Bit-Flips=1, Attack=COBRA
2025.12
73.39
57.33
Mamba2-370m
Bit-Flips=4, Attack=COBRA
2025.12
67.98
17.33
Mamba-370m
Bit-Flips=4, Attack=COBRA
2025.12
67.86
5.33
Quamba-1.4b-w8a8
Bit-Flips=4, Attack=COBRA
2025.12
54.67
46.67
Feedback
Search any
task
Search any
task