| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| HellaSwag | COLLATE | Accuracy99.21 | 1,896 | 2mo ago | |
| WinoGrande | GPTQ | Accuracy7,364 | 1,581 | 16d ago | |
| HellaSwag | MSRS | HellaSwag Accuracy87.4 | 897 | 26d ago | |
| PIQA | Accuracy94.9 | 757 | 2mo ago | ||
| Winogrande | Accuracy85.3 | 453 | 1mo ago | ||
| PIQA | BaLoRA | Accuracy89.99 | 400 | 16d ago | |
| CSQA | Token-ICS | Accuracy96 | 366 | 4mo ago | |
| Common Sense Reasoning Tasks | Dual LoRA | Avg Score93 | 321 | 2mo ago | |
| Commonsense Reasoning (BoolQ, PIQA, SIQA, HellaS., WinoG., ARC-e, ARC-c, OBQA) (test) | PaLM (540B) | BoolQ Accuracy88 | 283 | 24d ago | |
| ARC Challenge | Nemotron-3-Ultra 550B-A55B-Base | Accuracy97.35 | 259 | 1mo ago | |
| ARC-E | BaRA | Accuracy96.56 | 249 | 17d ago | |
| Commonsense Reasoning (BoolQ, PIQA, SIQA, HellaS., WinoG., ARC-e, ARC-c, OBQA) | LoRA-GA | BoolQ Accuracy89.69 | 245 | 23d ago | |
| ARC-C | Accuracy96.3 | 225 | 25d ago | ||
| StrategyQA | REBALANCE | Accuracy95.7 | 208 | 2mo ago | |
| CSQA | CSQA Accuracy91.2 | 195 | 2mo ago | ||
| OBQA | HydraLoRA | Accuracy89.2 | 187 | 2mo ago | |
| SIQA | In-Squeeze | Accuracy89.85 | 183 | 29d ago | |
| SocialIQA | Accuracy88.1 | 164 | 1mo ago | ||
| Wino | Accuracy86.55 | 146 | 2mo ago | ||
| CommonSenseQA | Accuracy91.2 | 136 | 4mo ago | ||
| CSQA (test) | KEAR | Accuracy89.4 | 123 | 1mo ago | |
| StrategyQA (test) | SGE | Accuracy83.49 | 119 | 1mo ago | |
| CommonsenseQA | DENOISE | Accuracy (pass@1)86.6 | 108 | 2mo ago | |
| OpenBookQA | Accuracy91.2 | 108 | 2mo ago | ||
| HellaSwag | SpikingBrain-76B | Accuracy86.63 | 106 | 17d ago |
