| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| SATURN Difficulty 3,5,15 2.6k (test) | SATURN-7B | Pass@185.4 | 3 | 4mo ago | |
| SATURN Difficulty 3,5,13 2.6k (test) | SATURN-7B | Pass@189.5 | 3 | 4mo ago | |
| SATURN 2.6k Difficulty 3,5,8 (test) | SATURN-1.5B | Pass@147 | 3 | 4mo ago | |
| SATURN 2.6k Difficulty 3,5,5 (test) | SATURN-1.5B | Pass@170.3 | 3 | 4mo ago |