MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction
About
Predicting human behavior is a difficult and crucial task required for motion planning. It is challenging in large part due to the highly uncertain and multi-modal set of possible outcomes in real-world domains such as autonomous driving. Beyond single MAP trajectory prediction, obtaining an accurate probability distribution of the future is an area of active interest. We present MultiPath, which leverages a fixed set of future state-sequence anchors that correspond to modes of the trajectory distribution. At inference, our model predicts a discrete distribution over the anchors and, for each anchor, regresses offsets from anchor waypoints along with uncertainties, yielding a Gaussian mixture at each time step. Our model is efficient, requiring only one forward inference pass to obtain multi-modal future distributions, and the output is parametric, allowing compact communication and analytical probabilistic queries. We show on several datasets that our model achieves more accurate predictions, and compared to sampling baselines, does so with an order of magnitude fewer trajectories.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Trajectory Prediction | nuScenes Prediction Challenge (test) | minADE (K=10)1.14 | 37 | |
| Trajectory Forecasting | Stanford Drone Dataset | Average Displacement Error (ADE)28.32 | 35 | |
| Motion | nuScenes (val) | -- | 34 | |
| Vehicle Trajectory Prediction | INTERACTION (val) | Min FDE (6)0.99 | 22 | |
| Trajectory Prediction | Argoverse (val) | minFDE61.68 | 11 | |
| Vehicle Trajectory Prediction | nuScenes vehicle-only (train val test) | ADE@52.32 | 7 | |
| Trajectory Prediction | nuScenes (val) | FDE (1s)10.16 | 6 | |
| Motion forecasting | Waymo Open Motion Dataset 2021 | minFDE2.04 | 6 | |
| Multi-agent trajectory forecasting | CARLA Town01 (5 agents) | Min MSD (1.2s)0.68 | 5 | |
| Multi-agent trajectory forecasting | CARLA Town02 (5 agents) | Min MSD 1.2s0.69 | 5 |