Decision Making

Benchmarks

Dataset Name	SOTA Method	Metric
DELIVERYBENCH	CoT+MemoryBank+None	Mean Hourly Profit41.71	121	1mo ago
AlfWorld		Steps6.4	22	4mo ago
ALFWorld, WebShop, ScienceWorld, BabyAI (test)	NPM + Workflows	ALFWorld Success Rate66.42	21	25d ago
WebShop	Dual-Process (AUQ)	Success Rate42.9	15	4mo ago
30 synthetic decision-making rounds (evaluation)	Lark Full	Mean Rank2.55	14	3mo ago
Decision Making OOD	TIMEOMNI-1	ACC58.9	13	4mo ago
Decision Making (ID)	TIMEOMNI-1	Accuracy47.9	13	4mo ago
MINIGRID	ReAct with ChatDB memory	Success Rate60	9	1mo ago
ALFWorld Avg v1	BeliefMem	Success Rate (SR)59.88	9	2mo ago
ALFWorld Unseen v1	BeliefMem	Success Rate (SR)61.19	9	2mo ago
ALFWorld Seen v1	BeliefMem	Success Rate (SR)63.57	9	2mo ago
Hiring Domain	DECISIVE	Top-1 Accuracy90.2	8	3mo ago
Finance Domain	DECISIVE	Top-1 Acc.79	8	3mo ago
Education Domain	DECISIVE	Top-1 Accuracy78.8	8	3mo ago
TSR-Suite Task 4	TIMEOMNI-VL	Accuracy61.4	8	4mo ago
Synthetic smoke five seeds (test)	UC-Beam	Reward25.0009	7	1mo ago
MLGym Blotto		Score0.5	7	1mo ago
MLGym Prisoner's Dilemma		Payoff3	7	1mo ago
MLGym Battle of Sexes	ARTS	Payoff2	7	1mo ago
OAS (test)		Timely Score0.5037	7	4mo ago
GlobalStore (test)		Timeliness Score35.52	7	4mo ago
DataCo (test)	S2A	Timely Score0.5447	7	4mo ago
OR-ShARC (test)	EFT	Micro Aggregation Score0.785	7	4mo ago
OR-ShARC (dev)	EFT	Micro Avg83.4	7	4mo ago
vignette-based (inference)	MeTHanol (8B)	Vignette Score48.3	6	2mo ago

Showing 25 of 52 rows