Share your thoughts, 1 month free Claude Pro on usSee more

Routing

Benchmarks

Dataset Name	SOTA Method	Metric
GSO novel objects {c ∈ C0}	SCOUT	Regret0.4831	24	18d ago
GSO (novel objects)	SCOUT	Regret0.4319	11	18d ago
SPROUT (test)		Accuracy98.6	11	1mo ago
RouterBench (test)		Accuracy91.4	11	1mo ago
Synthetic network low demand, low obstacle	MKL-hierarchical	Average Delay0.224	7	20d ago
Synthetic network low demand, medium obstacle		Average Delay0.207	7	20d ago
Synthetic network low demand, high obstacle		Average Delay0.218	7	20d ago
Synthetic network medium demand, low obstacle		Average Delay0.354	7	20d ago
Synthetic network medium demand, medium obstacle	SVC-hierarchical	Average Delay0.343	7	20d ago
Synthetic network medium demand, high obstacle		Average Delay0.356	7	20d ago
Synthetic network high demand, low obstacle	MKL-hierarchical	Average Delay0.439	7	20d ago
Synthetic network high demand, medium obstacle	MKL-hierarchical	Average Delay0.464	7	20d ago
Synthetic network high demand, high obstacle	SVC-random	Average Delay0.446	7	20d ago
OOD Average (HotpotQA, GPQA, SVAMP)	CONCUR	Acc62.6	5	1mo ago
SVAMP	RTR	Accuracy92.4	5	1mo ago
GPQA	EmbedLLM	Accuracy35.3	5	1mo ago
HotpotQA	CONCUR	Accuracy60.6	5	1mo ago
EMA-150	PG-GAT-Edge	Solution Time (s)1.03	5	1mo ago
EMA-100	DRL-S2V	Solution Time (s)0.63	5	1mo ago
EMA-50	PG-GAT-Edge	Solution Time (s)0.45	5	1mo ago
Stochastic Vienna City Routing Networks (Vienna-300)	PG-GAT-Edge	Customers Served28.2	4	1mo ago
Stochastic Vienna City Routing Networks (Vienna-160)	PG-GAT-Edge	Customers Served Rate47.9	4	1mo ago
Vienna-300	PG-GAT-Edge	Solution Time (s)1.85	4	1mo ago
Vienna-160	PG-GAT-Edge	Solution Time (s)0.78	4	1mo ago
RouterBench	-	Accuracy-	0	1mo ago

Showing 25 of 25 rows