LM Evaluation Suite
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Zero-shot Multiple Choice Question Answering and Reasoning | LM Evaluation Suite ARC, Hellaswag, LogiQA, PiQA, SciQ (test) | ARC-C23.2 | 8 | |
| Zero-shot Downstream Task Evaluation | Zero-shot LM Evaluation Suite (MMLU, HellaSwag, WinoGrande, PIQA, ARC-E, ARC-C, OBQA) | MMLU59.8 | 6 |
Showing 2 of 2 rows