Reasoning GYM
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Reasoning | Reasoning-Gym (test) | Accuracy70.1 | 28 | |
| Reasoning | Reasoning-Gym (train) | Accuracy63.3 | 28 | |
| General Reasoning | Reasoning GYM | Accuracy (Reasoning GYM)8.8 | 10 | |
| Logical Reasoning | Reasoning Gym Color Cube | Accuracy (*)32 | 8 | |
| Logical Reasoning | Reasoning Gym Leg Counting | Accuracy50.67 | 8 | |
| Logical Reasoning | Reasoning Gym Zebra Puzzles | Accuracy (*)39.33 | 8 | |
| Reasoning | Reasoning Gym Puzzle24 | Success Rate60.67 | 8 | |
| Reasoning | Reasoning Gym Word Sorting | Success Rate84.33 | 8 | |
| Reasoning | Reasoning Gym Spell Backward | Success Rate97 | 8 | |
| Reasoning | Reasoning Gym Manipulate Matrix | Success Rate8.33 | 8 | |
| Reasoning | Reasoning Gym ARC-1D | Success Rate30.67 | 8 |
Showing 11 of 11 rows