| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Calc. | ATLAS (cluster) | Accuracy83.3 | 16 | 3mo ago | |
| Basic Arithmetic | 1DC Score0.192 | 14 | 3mo ago | ||
| ARI-ADD (test) | LIME+1 | Accuracy (ARI-ADD Test)58.7 | 9 | 3mo ago | |
| ARI-ADD | LIME+1 | Accuracy58.7 | 6 | 3mo ago | |
| Basic Arithmetic (test) | FairSeq | 1DC Error0 | 6 | 3mo ago | |
| Arithmetic | Ensemble | Accuracy97.8 | 5 | 26d ago | |
| ALU | VNN Full | Accuracy99.9 | 3 | 26d ago | |
| Arithmetic | MechaRule | HQ Neuron Count273 | 2 | 28d ago | |
| Arithmetic concept family | Mamba-1.4B | Accuracy0 | 2 | 1mo ago |
