Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
LLM Routing on In-domain datasets Cost First, alpha=0.8
Loading...
93
Accuracy
Oracle
35.8
50.65
65.5
80.35
Oct 22, 2025
Accuracy
Cost
Utility
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Cost
Utility
Oracle
type=Topline
2025.10
93
0.29
0.7
Largest LLM
type=Naive Baselines
2025.10
85
0.9
0.13
DiSRouter
Mode=SFT
2025.10
77
0.42
0.43
DiSRouter
Mode=SFT + RL
2025.10
75
0.29
0.52
Random
type=Naive Baselines
2025.10
67
0.46
0.3
GraphRouter
type=Router Baselines
2025.10
61
0.2
0.45
FrugalGPT
type=Router Baselines
2025.10
60
0.21
0.43
FORC
type=Router Baselines
2025.10
60
0.29
0.37
RouteLLM
type=Router Baselines
2025.10
44
0.16
0.31
Automix
type=Router Baselines
2025.10
44
0.33
0.18
Smallest LLM
type=Naive Baselines
2025.10
38
0.1
0.3
Feedback
Search any
task
Search any
task