Decision Making

Benchmarks

Dataset Name	SOTA Method	Metric
AlfWorld		Steps6.4	22	1mo ago
WebShop	Dual-Process (AUQ)	Success Rate42.9	15	1mo ago
30 synthetic decision-making rounds (evaluation)	Lark Full	Mean Rank2.55	14	11d ago
Decision Making OOD	TIMEOMNI-1	ACC58.9	13	1mo ago
Decision Making (ID)	TIMEOMNI-1	Accuracy47.9	13	1mo ago
TSR-Suite Task 4	TIMEOMNI-VL	Accuracy61.4	8	1mo ago
OAS (test)		Timely Score0.5037	7	1mo ago
GlobalStore (test)		Timeliness Score35.52	7	1mo ago
DataCo (test)	S2A	Timely Score0.5447	7	1mo ago
OR-ShARC (test)	EFT	Micro Aggregation Score0.785	7	1mo ago
OR-ShARC (dev)	EFT	Micro Avg83.4	7	1mo ago
Deliberative decision-making tasks n=45 (overall)	DCI	Mean Tokens237,565	5	1mo ago
Pandora's Box		Optimal Match Rate1	5	1mo ago
SinerGym (test)	Vintix II	Normalized Score92	4	10d ago
MuJoCo (test)	Vintix II	Normalized Score1	4	10d ago
MetaDrive (test)	Vintix	Normalized Score1.02	4	10d ago
Meta-World (test)	Vintix II	Normalized Score69	4	10d ago
Kinetix (test)	Vintix II	Normalized Score0.23	4	10d ago
Industrial Benchmark (test)	Vintix II	Normalized Score0.98	4	10d ago
HumEnv (test)	Vintix II	Normalized Score9	4	10d ago
ControlGym (test)	Vintix	Normalized Score100	4	10d ago
CityLearn (test)	Vintix II	Normalized Score78	4	10d ago
Bi-DexHands (test)	Vintix	Normalized Score0.45	4	10d ago
StarCraft II (SC2) built-in AI LV7 (VeryHard) (test)	StarWM-Agent	Win Rate50	4	1mo ago
StarCraft II built-in AI LV6 (Harder) (test)	StarWM-Agent	Win Rate40	4	1mo ago

Showing 25 of 36 rows