World Modeling

Benchmarks

Dataset Name	SOTA Method	Metric
WorldPrediction-WM	VL-JEPA SFT	Accuracy65.7	20	3mo ago
ScienceWorld	NeSyS	Matter Score52.8	20	3mo ago
Plancraft	NeSyS	Smelt98.4	20	3mo ago
Webshop (test)		Search100	20	3mo ago
WorldArena (test)	Wan2.6	Image Quality67.36	15	26d ago
nuScenes	GEM	CD (Inner)0.3	12	23d ago
KITTI Odometry	GEM	CD Inner0.13	10	23d ago
WorldArena	CtrlWorld	EWMScore59.7	7	14d ago
WorldScore	FantasyWorld-1.0	Dynamic Score71.39	7	1mo ago
1-min World Modeling Benchmark Hard-Trajectory	Infinite-World	R Score41.31	6	19d ago
1-min world modeling benchmark Simple-Trajectory	SANA-WM + refiner	R (Trajectory Fidelity)4.5	6	19d ago
60-second benchmark (Hard-Trajectory)	SANA-WM + refiner	PSNR14.8	6	19d ago
60-second benchmark (Simple-Trajectory)	LingBot-World	PSNR14.59	6	19d ago
Manhattan taxi rides		Next-Token Test Accuracy100	5	9d ago
Crafter-OO	ONELIFE	Rank @ 118.7	5	1mo ago
Robosuite Push In-Distribution (test)	OrbiSim	PSNR (10 frames)26.7105	4	15d ago
WorldScore	DreamWorld	3D Consistency73.16	4	3mo ago
River Raid (test)	Finite Automata Extraction	FID0.13	3	12d ago
River Raid (train)	Finite Automata Extraction	FID0.14	3	12d ago
Pac-Man (test)		FID0.23	3	12d ago
Pac-Man (train)		FID0.19	3	12d ago
MIND First 50 (test)	Matrix-Game 2.0	Context Memory11.88	3	3mo ago
MIND-Third 50 1.0 (test)	Matrix-Game 2.0	Long Context Memory0.1404	3	3mo ago
Robosuite Push Out-of-Distribution (test)	OrbiSim	PSNR (10 steps)27.1867	2	15d ago
WorldModelBench Robot in office scenario (test)	Multi-Agent Framework	Total Score6.9	2	19d ago

Showing 25 of 31 rows