Graph Neural Networks are Heuristics
About
Graph neural networks are usually treated as auxiliaries for combinatorial optimization: they imitate algorithms, guide search, or supply scores to classical procedures. We show that this auxiliary role is not intrinsic. A GNN can itself be a heuristic. For the Euclidean Travelling Salesman Problem, we train a non-autoregressive GNN with no labels, rewards, sequential decoding, search, or local improvement. A differentiable Hamiltonian-cycle objective is the only supervision. The trained model produces a complete tour in one forward pass, while dropout and snapshots from a single training trajectory provide solution diversity without engineered moves. The heuristic is therefore learned, not programmed. It is also fast: batched inference remains in the millisecond regime on GPUs. Experiments on TSP100, TSP200, and TSP500 show that the model consistently improves over nearest-neighbor greedy baselines. These results identify unsupervised GNNs as a class of fast learned heuristics for combinatorial optimization.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Traveling Salesman Problem | Euclidean TSP n=500 Uniform distribution in unit square (test) | Tour Length18.47 | 27 | |
| Traveling Salesman Problem | Euclidean TSP n=100 Uniform distribution in unit square (test) | Tour Length8.09 | 27 | |
| Traveling Salesman Problem | Euclidean TSP n=200 Uniform distribution in unit square (test) | Tour Length11.55 | 14 |