Plan Generation

Benchmarks

Dataset Name	SOTA Method	Metric
60-task evaluation suite 10 domains		Code PQS89	19	4mo ago
Robo Challenge (Online)	State-Aware CP-SAT Repair	Plan Accuracy85.7	16	1mo ago
Robo Challenge (Offline)	CP-SAT Formalizer	Plan Accuracy100	12	1mo ago
Logistics 1.0 (extrapolation)		QS0	7	26d ago
Logistics 1.0 (interpolation)		QS Score38	7	26d ago
Logistics 1.0 (val)		Quality Score (QS)8	7	26d ago
Visitall 1.0 (extrapolation)	SymTED	QS60	7	26d ago
Visitall 1.0 (interpolation)	SymTE	QS1	7	26d ago
Visitall 1.0 (val)	SymTE	QS Score100	7	26d ago
Gripper 1.0 (extrapolation)	SymTED	QS0.77	7	26d ago
Gripper 1.0 (interpolation)	SymTED	QS1	7	26d ago
Gripper 1.0 (val)	SymTE	Quality Score (QS)0.99	7	26d ago
Blocks 1.0 (extrapolation)	SymTED	QS0.13	7	26d ago
Blocks 1.0 (interpolation)	SymTE	QS Score100	7	26d ago
Blocks 1.0 (val)	SymTE	QS1	7	26d ago
RecipeNLG (test)	Self-Ask	BLEU91.3	7	4mo ago
WikiHow (test)	Self-Ask	ROUGE-156.1	7	4mo ago
6 grid world domains Unseen Appearances	VLMFP	Success Rate (Frozenlake)81.1	6	4mo ago
6 grid world domains Seen Appearances	VLMFP	Success Rate (Frozenlake)95.2	6	4mo ago
Commonly solved tasks	DeepSeek	Runtime Ratio0.36	4	4mo ago

Showing 20 of 20 rows