Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Generalized Trajectory Scoring for End-to-end Multimodal Planning

About

End-to-end multi-modal planning is a promising paradigm in autonomous driving, enabling decision-making with diverse trajectory candidates. A key component is a robust trajectory scorer capable of selecting the optimal trajectory from these candidates. While recent trajectory scorers focus on scoring either large sets of static trajectories or small sets of dynamically generated ones, both approaches face significant limitations in generalization. Static vocabularies provide effective coarse discretization but struggle to make fine-grained adaptation, while dynamic proposals offer detailed precision but fail to capture broader trajectory distributions. To overcome these challenges, we propose GTRS (Generalized Trajectory Scoring), a unified framework for end-to-end multi-modal planning that combines coarse and fine-grained trajectory evaluation. GTRS consists of three complementary innovations: (1) a diffusion-based trajectory generator that produces diverse fine-grained proposals; (2) a vocabulary generalization technique that trains a scorer on super-dense trajectory sets with dropout regularization, enabling its robust inference on smaller subsets; and (3) a sensor augmentation strategy that enhances out-of-domain generalization while incorporating refinement training for critical trajectory discrimination. As the winning solution of the Navsim v2 Challenge, GTRS demonstrates superior performance even with sub-optimal sensor inputs, approaching privileged methods that rely on ground-truth perception. Code will be available at https://github.com/NVlabs/GTRS.

Zhenxin Li, Wenhao Yao, Zi Wang, Xinglong Sun, Joshua Chen, Nadine Chang, Maying Shen, Zuxuan Wu, Shiyi Lan, Jose M. Alvarez• 2025

Related benchmarks

TaskDatasetResultRank
Autonomous Driving PlanningNAVSIM navhard v2
NC98.9
108
Autonomous Driving PlanningNAVSIM (navtest)
NC98.5
91
Autonomous Driving PlanningNAVSIM v2 (Navtest)
NC97.6
76
Autonomous Driving Trajectory PlanningNAVSIM navhard-two-stage v2 (test)
Stage 1 NC98.9
48
Trajectory PlanningNAVSIM v2 (navhard)
NC Rate98.9
43
PlanningNavSim (Navhard)
NC91.9
42
Autonomous Driving PlanningNav. (test)
NC99
28
Planning EvaluationNAVSIM navhard v2
NC98.9
28
Autonomous DrivingNAVSIM v2 (test)
NC99.1
25
Autonomous DrivingHUGSIM Easy
Reachability Coverage (RC)64.2
25
Showing 10 of 31 rows

Other info

Follow for update