Zero-shot Language Evaluation on 7-Task Suite (BoolQ, PIQA, HellaSwag, WinoGrande, ARC-E, ARC-C, OBQA) (test)
62.9BoolQ Accuracy
Mamba-2 FP16
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
2026.06 | 62.9 | 73.7 | 59.9 | 61.1 | 60.4 | 33.2 | 37.4 | 55.5 | |
2026.06 | 60 | 68.8 | 47.3 | 55.9 | 48 | 26.3 | 32.2 | 48.4 | |
2026.06 | 56.7 | 68.8 | 37.7 | 55.8 | 54.9 | 24.2 | 19.6 | 45.4 | |
2026.06 | 56 | 69.3 | 47.5 | 56.3 | 48.2 | 25.9 | 33.8 | 48.1 |