PostDeg: Placement Beats Parameterization in LayerNorm GNNs
About
LayerNorm-based GNNs routinely erase the topology signals (degree, centrality, $k$-core) that node-selection policies should depend on, but the literature has not located where in the residual block the erasure happens. We answer that question: a positive per-node scalar inserted before LayerNorm is divided out up to a stabilizer term, while the same scalar inserted after LayerNorm reaches the score head as representation magnitude. The surviving slot is the post-LayerNorm position. We instantiate it with PostDeg, a parameter-free post-LayerNorm inverse-degree scale, and pre-register four falsifiers (graphwise scalars, extra LayerNorm, expressive same-slot capacity, backbone-agnostic source) that would reject the rule. PostDeg gains $+3.5\%/+2.5\%/+5.6\%$ over the LN backbone on influence maximization, network dismantling, and maximum independent set, with $10/10$ paired-seed wins per task; none of the four falsifiers fires. The takeaway is that placement, not parameterization, carries the gain -- a small invariance check that generalizes to any positive topology scalar in any normalized residual stack.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Influence Maximization | InfluMax Node-selection | Relative Improvement over LN Backbone3.61 | 9 | |
| Maximum Independent Set | Node-selection MIS | Relative Improvement over LN Backbone6.09 | 9 | |
| Graph Dismantling | Node-selection Dismantle | Relative Improvement (LN Backbone)2.65 | 9 | |
| Epidemic Spread | Epidemic | Relative Improvement over LN Backbone17 | 9 |