Share your thoughts, 1 month free Claude Pro on usSee more

Model Routing on Dataset A

83.25Accuracy (Selected Answer)

3-model oracle

Updated 1mo ago

Evaluation Results

Method	Links
3-model oracle 2026.06		83.25	100	-	-	-	-	-
Brick max 2026.06		76.98	17.77	0.0221	-	0	31	69
Brick high 2026.06		76.24	35.63	0.0149	-	21	35	44
always kimi 2026.06		75.02	21.28	0.0307	-	0	0	100
RouteLLM binary 2026.06		75.02	21.31	0.0307	-	0	0	100
RouteLLM tournament 2026.06		75.02	21.31	0.0307	-	0	0	100
Brick neutral 2026.06		74.11	40.35	0.0065	-	29	56	15
always ds4 2026.06		73.69	15.55	0.0029	-	0	100	0
Cascade Routing 2026.06		73.4	28.96	0.0061	0.0061	18	61	21
Brick low 2026.06		71.62	48.66	0.0036	-	45	51	5
FrugalGPT cascade 2026.06		69.42	31.03	0.0028	0.0041	33	64	3
always qwen 2026.06		63.17	63.17	0.0014	-	100	0	0
Brick min 2026.06		63.17	63.17	0.0014	-	100	0	0