Circuit Recovery Evaluation Suite (IOI, MCQA, Arithmetic, ARC) Llama-3 (3B to 8B) Transfer (test)
46Arithmetic (+) Score
NAP-IG-Inputs
Updated 1mo ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2026.04 | 46 | 63 | 1.02 | 37 | 97 | 94 | 73 | |
2026.04 | 46 | 50 | 0.54 | 53 | 53 | 56 | 52 | |
2026.04 | 45 | 49 | 0.26 | 45 | 30 | 34 | 38 | |
2026.04 | 40 | 23 | 0.27 | 40 | 29 | 28 | 31 | |
2026.04 | 36 | - | - | 37 | 28 | 29 | 32 | |
2026.04 | 33 | 35 | 0.6 | 31 | 59 | 63 | 47 | |
2026.04 | 29 | - | - | 67 | 34 | 34 | 41 | |
2026.04 | 28 | 44 | 0.5 | 59 | 36 | 43 | 43 | |
2026.04 | 27 | 57 | 0.46 | 46 | 27 | 25 | 38 | |
2026.04 | 27 | 36 | 0.32 | 26 | 29 | 27 | 30 | |
2026.04 | 27 | - | - | 59 | 56 | 56 | 49 | |
2026.04 | 25 | 25 | 0.25 | 25 | 25 | 25 | 25 | |
2026.04 | 25 | 31 | 0.38 | 29 | 57 | 59 | 40 |