Share your thoughts, 1 month free Claude Pro on usSee more

Predictive LLM Routing on AlpacaEval

63.17Score (vs OpenAI)

Oracle

Updated 16d ago

Evaluation Results

Method	Links
Oracle 2025.05		63.17	52.98	34.69
Linear 2025.05		57.6	52.84	34.26
MLP 2025.05		57.5	52.84	34.2
kNN 2025.05		57.38	52.77	34.26
Graph 2025.05		57.37	51.84	32.25
kNN 2025.05		57.33	52.82	34.27
D-Attn 2025.05		57.17	52.77	24.45
Linear 2025.05		56.85	52.08	33.76
Graph 2025.05		55.66	45.64	31.5
MLP 2025.05		55.5	51.29	32.18
Attn 2025.05		55.29	52.49	27.94
MLP 2025.05		54.71	51.14	30.96
Linear 2025.05		54.61	51.14	30.96
Graph 2025.05		54.61	51.14	30.96
Linear 2025.05		54.54	51.14	30.96
Graph 2025.05		54.52	51.14	30.95
D-Attn 2025.05		54.5	44.62	29.34
Attn 2025.05		54.43	45.12	26.52
Attn 2025.05		54.08	51.14	30.91
Attn 2025.05		54.04	51.14	30.96
D-Attn 2025.05		53.84	51.14	30.91
D-Attn 2025.05		53.55	51.14	30.96
MLP 2025.05		50.81	51.14	30.52
kNN 2025.05		38.32	42.04	23.72
kNN 2025.05		37.89	43.99	23.88
Random 2025.05		36.47	34.56	27.76