Held-out capability
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Capability Retention | Held-out capability AIME-2024, MATH-500, GSM8K, HumanEval, MMLU (test) | AIME-2024 Score63.5 | 39 | |
| General capability retention | Held-out capability average | Unweighted Average Accuracy82.6 | 21 |
Showing 2 of 2 rows