Share your thoughts, 1 month free Claude Pro on usSee more

Zero-shot Coordination

Benchmarks

Dataset Name	SOTA Method	Metric
Overcooked-AI Forced Coordination	CausalPlan	Mean Team Reward64.3	18	1mo ago
Overcooked-AI Counter Circuit	Co-π-tree	Mean Team Reward117.8	18	1mo ago
Overcooked-AI Coordination Ring	Co-π-tree	Mean Team Reward165.9	18	1mo ago
Overcooked-AI Cramped Room	Co-π-tree	Mean Team Reward182.3	18	1mo ago
Point Mass Rendezvous Differentiated	ConventionPlay	Coordination Efficiency96.05	12	3mo ago
Point Mass Rendezvous Uniform	ConventionPlay	Coordination Efficiency (η)99.96	12	3mo ago
Matrix Game Differentiated	SyKLRBR	Coordination Efficiency (η)91.65	12	3mo ago
Matrix Game Uniform	SyKLRBR	Coordination Efficiency (η)90	12	3mo ago
Hanabi (test)	OBL-L5	XP Score23.89	12	4mo ago
Overcooked-AI Zero-shot evaluation with artificial partners standard five layouts	UPD w/o bias	CRoom Score111.5	7	1mo ago
Overcooked Asymmetric Advantages layout v1	IPPO	SP500	7	2mo ago
Overcooked Forced Coordination layout v1	IPPO	SP200	7	2mo ago
Overcooked Coordination Ring layout v1	SBC	SP333	7	2mo ago
Overcooked Counter Circuit layout v1	SBC	SP Score246	7	2mo ago
Overcooked Unident_s environment (test)	Surrogate Network	Sparse Reward78.5	7	2mo ago
Overcooked Random0_Medium (test)	LLM-Based	Shaped Reward146.1	7	2mo ago
Overcooked Random3 environment (evaluation)	Stratified Grid	Sparse Reward131.4	7	2mo ago
Overcooked Random3	Stratified Grid	Shaped Reward107.4	7	2mo ago
Overcooked Random0_Medium	Surrogate Network	Sparse Reward59.3	7	2mo ago
Unident s	Surrogate Network	Shaped Reward67.8	7	2mo ago
Multi-Destination Spread	IPPO	SP990	6	2mo ago
Moving Out Map 12 human proxies 1.0 (unseen)	DP/BASS	TCR38.55	3	1mo ago
Moving Out Map 12 human proxies 1.0 (seen)	DP/BASS	TCR59.93	3	1mo ago
Moving Out Map 1 human proxies 1.0 (unseen)	DP/BASS	TCR70.8	3	1mo ago
Moving Out Map 1 human proxies 1.0 (seen)	DP/BASS	TCR78.68	3	1mo ago

Showing 25 of 25 rows