Out-of-Domain Reasoning Suite
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Reasoning | Out-of-Domain Reasoning Suite | ARC-c Score94.5 | 29 | |
| Reasoning | Out-of-Domain (OOD) Reasoning Suite (ARC-c, GPQA*, MMLU-Pro) various (test) | ARC-c Accuracy (avg@4)93.9 | 21 | |
| Out-of-Domain Reasoning | Out-of-Domain Reasoning Suite BGQA, CRUX Eval, Strategy QA, Table Bench | BGQA Accuracy71.1 | 9 |
Showing 3 of 3 rows