AQUA-RAT
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | AQUA-RAT | Accuracy91.73 | 153 | |
| Mathematical Reasoning | AQuA-RAT (test) | Accuracy83 | 40 | |
| Mathematical Calculation | AQuA-RAT | Accuracy (AQuA-RAT)83.1 | 20 | |
| Algebraic Reasoning | AQuA-RAT | Accuracy66.8 | 16 | |
| Algebraic Question Answering | AQUA-RAT Synthetic NIID 1.0 (test) | Accuracy28 | 7 | |
| Algebraic Question Answering | AQUA-RAT Synthetic IID 1.0 (test) | Accuracy29.9 | 7 | |
| Mathematical Reasoning | AQuA-RAT Multiple Client (test) | Client 1 Accuracy64.92 | 6 | |
| Mathematical Reasoning | AQuA-RAT Single Client | Accuracy0.6102 | 6 | |
| Math reasoning | AQuA-RAT | Accuracy59.06 | 3 | |
| Mathematical Reasoning | AQUA-RAT STREET | Answer Accuracy78 | 3 | |
| Mathematical Reasoning | AQUA-RAT standard (test) | ACC (%)40.16 | 3 | |
| Algebraic Reasoning | AQuA-RAT | PTR Advance Rate100 | 2 |
Showing 12 of 12 rows