Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
LLM Routing on In-domain datasets Balance, alpha=0.5
Loading...
93
Accuracy
Oracle
35.8
50.65
65.5
80.35
Oct 22, 2025
Accuracy
Cost
Utility
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Cost
Utility
Oracle
type=Topline
2025.10
93
0.29
0.79
Largest LLM
type=Naive Baselines
2025.10
85
0.9
0.4
DiSRouter
Mode=SFT
2025.10
83
0.52
0.57
GraphRouter
type=Router Baselines
2025.10
77
0.46
0.53
DiSRouter
Mode=SFT + RL
2025.10
77
0.32
0.61
FORC
type=Router Baselines
2025.10
69
0.45
0.47
Random
type=Naive Baselines
2025.10
67
0.46
0.44
FrugalGPT
type=Router Baselines
2025.10
63
0.22
0.52
Automix
type=Router Baselines
2025.10
58
0.58
0.29
RouteLLM
type=Router Baselines
2025.10
44
0.16
0.36
Smallest LLM
type=Naive Baselines
2025.10
38
0.1
0.33
Feedback
Search any
task
Search any
task