Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
LLM Routing on In-domain datasets Performance First, alpha=0.2
Loading...
93
Accuracy
Oracle
35.8
50.65
65.5
80.35
Oct 22, 2025
Accuracy
Cost
Utility
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Cost
Utility
Oracle
type=Topline
2025.10
93
0.29
87
Largest LLM
type=Naive Baselines
2025.10
85
0.9
67
Automix
type=Router Baselines
2025.10
85
1.1
63
DiSRouter
Mode=SFT
2025.10
84
0.59
72
GraphRouter
type=Router Baselines
2025.10
82
0.68
68
DiSRouter
Mode=SFT + RL
2025.10
81
0.4
73
FORC
type=Router Baselines
2025.10
78
0.65
65
FrugalGPT
type=Router Baselines
2025.10
70
0.32
64
Random
type=Naive Baselines
2025.10
67
0.46
58
RouteLLM
type=Router Baselines
2025.10
44
0.16
41
Smallest LLM
type=Naive Baselines
2025.10
38
0.1
36
Feedback
Search any
task
Search any
task