| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Short Context Benchmarks MMLU, SciQ, OQA, CQA, SIQA, PIQA, HellaSwag, WinoGrande, ARC-c, ARC-e | MMLU Accuracy74.25 | 10 | 2mo ago | ||
| EleutherAI lm-eval-harness ARC-C, ARC-E, HellaSwag, PIQA, WinoGrande standard (test val) | Q-MQA | ARC-Challenge Accuracy22.7 | 6 | 1mo ago |