Rethinking Positional Encoding for Neural Vehicle Routing
About
Transformer-based models have become the dominant paradigm for neural combinatorial optimization (NCO) of vehicle routing problems (VRPs), yet the role of positional encoding (PE) in these architectures remains largely unexplored. Unlike natural language, where tokens are uniformly spaced on a line, routing solutions exhibit several properties that render standard NLP positional encodings inadequate. In this work, we formalize three such structural properties that a routing-aware PE should respect, namely anisometric node distances, cyclic and direction-aware topology, and hierarchical depot-anchored global multi-route structure, combining them with a unifying design principle of geometric grounding. Guided by these criteria, we analyze and compare PE methods spanning NLP, graph-transformer, and routing-specific families, and propose a hierarchical anisometric PE that combines a distance-indexed, circularly consistent in-route encoding with a depot-anchored angular cross-route encoding. Extensive experiments across diverse VRP variants demonstrate that geometry-grounded PE consistently outperforms index-based alternatives, with gains that transfer across problem variants, model architectures, and distribution shifts.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Capacitated Vehicle Routing Problem | CVRP 1000 | Objective Value41.05 | 29 | |
| Capacitated Vehicle Routing Problem | CVRP500 | Objective Value36.54 | 25 | |
| Vehicle Routing Problem with Time Windows | VRPTW 500 customers | Objective Value47.9 | 11 | |
| Vehicle Routing Problem with Time Windows | VRPTW 1K customers | Objective Value87.45 | 11 | |
| Capacitated Vehicle Routing Problem | CVRP Low Capacity 500 instances (test) | Objective Value91.04 | 5 | |
| Capacitated Vehicle Routing Problem | CVRP Clustered Distribution 500 instances (test) | Objective Value44.22 | 5 | |
| Pickup and Delivery Traveling Salesman Problem | PDTSP-51 | Objective Value6.997 | 4 | |
| Pickup and Delivery Traveling Salesman Problem | PDTSP-101 | Objective Value9.701 | 4 | |
| Pickup and Delivery Traveling Salesman Problem | PDTSP-21 | Objective Value4.564 | 4 | |
| Capacitated Vehicle Routing Problem | CVRP 2000 | Objective Value55.98 | 3 |