AQUA-RAT
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | AQUA-RAT | Accuracy91.73 | 120 | |
| Mathematical Reasoning | AQuA-RAT (test) | Accuracy83 | 40 | |
| Mathematical Calculation | AQuA-RAT | Accuracy (AQuA-RAT)83.1 | 20 | |
| Algebraic Reasoning | AQuA-RAT | Accuracy66.8 | 16 | |
| Algebraic Question Answering | AQUA-RAT Synthetic NIID 1.0 (test) | Accuracy28 | 7 | |
| Algebraic Question Answering | AQUA-RAT Synthetic IID 1.0 (test) | Accuracy29.9 | 7 | |
| Mathematical Reasoning | AQUA-RAT STREET | Answer Accuracy78 | 3 | |
| Mathematical Reasoning | AQUA-RAT standard (test) | ACC (%)40.16 | 3 | |
| Algebraic Reasoning | AQuA-RAT | PTR Advance Rate100 | 2 |
Showing 9 of 9 rows