Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PostDeg: Placement Beats Parameterization in LayerNorm GNNs

About

LayerNorm-based GNNs routinely erase the topology signals (degree, centrality, $k$-core) that node-selection policies should depend on, but the literature has not located where in the residual block the erasure happens. We answer that question: a positive per-node scalar inserted before LayerNorm is divided out up to a stabilizer term, while the same scalar inserted after LayerNorm reaches the score head as representation magnitude. The surviving slot is the post-LayerNorm position. We instantiate it with PostDeg, a parameter-free post-LayerNorm inverse-degree scale, and pre-register four falsifiers (graphwise scalars, extra LayerNorm, expressive same-slot capacity, backbone-agnostic source) that would reject the rule. PostDeg gains $+3.5\%/+2.5\%/+5.6\%$ over the LN backbone on influence maximization, network dismantling, and maximum independent set, with $10/10$ paired-seed wins per task; none of the four falsifiers fires. The takeaway is that placement, not parameterization, carries the gain -- a small invariance check that generalizes to any positive topology scalar in any normalized residual stack.

Yash Tomar, Aryav Das• 2026

Related benchmarks

TaskDatasetResultRank
Influence MaximizationInfluMax Node-selection
Relative Improvement over LN Backbone3.61
9
Maximum Independent SetNode-selection MIS
Relative Improvement over LN Backbone6.09
9
Graph DismantlingNode-selection Dismantle
Relative Improvement (LN Backbone)2.65
9
Epidemic SpreadEpidemic
Relative Improvement over LN Backbone17
9
Showing 4 of 4 rows

Other info

Follow for update