| CEVAL and GSM8K (OOD) | NIRT-Router | Performance87.46 | | 21 | 3d ago |
| MMLU, CMMLU, etc. In-distribution | NIRT-Router | Performance80.69 | | 21 | 3d ago |
| Average across Benchmarks (val) | | Avg Top-1 Acc83 | | 14 | 3d ago |
| BBEH (val) | | Top-1 Acc66.4 | | 14 | 3d ago |
| MEDMCQA (val) | | Top-1 Acc96.3 | | 14 | 3d ago |
| SUPERGPQA (val) | | Top-1 Acc0.776 | | 14 | 3d ago |
| MMLU-PRO (val) | | Top-1 Acc91.5 | | 14 | 3d ago |
| BBEH | | Top-1 Accuracy66.4 | | 14 | 3d ago |
| MedMCQA | | Top-1 Acc96.3 | | 14 | 3d ago |
| SUPERGPQA | | Top-1 Acc77.6 | | 14 | 3d ago |
| MMLU-PRO | | Top-1 Acc91.5 | | 14 | 3d ago |
| MMLU-PRO, SUPERGPQA, MEDMCQA, BBEH (test) | | MMLU-PRO Top-1 Acc91.5 | | 14 | 3d ago |
| MMR-Bench | EquiRouter | nAUC0.7059 | | 11 | 3d ago |
| RouterBench | EquiRouter | nAUC0.7712 | | 11 | 3d ago |
| MMR-Bench Out-of-domain | EquiRouter | nAUC0.6701 | | 9 | 3d ago |
| RouterBench Out-of-domain | EquiRouter | nAUC75.6 | | 9 | 3d ago |
| MMLU Pro Others (Out-of-Domain) | ProbeDirichlet | LPM0.6242 | | 7 | 3d ago |
| MMLU Pro Social Sciences (Out-of-Domain) | SelfAsk | LPM59.2 | | 7 | 3d ago |
| MMLU Pro Humanities Out-of-Domain | ProbeDirichlet | LPM51.74 | | 7 | 3d ago |
| MMLU Pro STEM (Out-of-Domain) | ProbeDirichlet | LPM59.2 | | 7 | 3d ago |
| MATH Out-of-Domain | ProbeDirichlet | LPM Score69.24 | | 7 | 3d ago |
| Magpie Out-of-Domain | ProbeDirichlet | LPM Score63.53 | | 7 | 3d ago |
| MMLU In-Domain | ProbeDirichlet | LPM78.51 | | 7 | 3d ago |
| MMLU Pro Out-of-Domain | ProbeDirichlet | STEM Score65.32 | | 7 | 3d ago |
| MATH Out-of-Domain | ProbeDirichlet | AUROC73.9 | | 7 | 3d ago |