The Value of Depth in Message Passing on Sparse Graphs: A Kesten-Stigum Dichotomy
math.ST, cs.LG, math.PR, stat.ML, stat.TH
Submitted: 2026-07-18
Updated: 2026-08-29
Comments: 27 pages, 4 figures, 1 table. Code reproducing all numerical results is included as ancillary files
License: http://creativecommons.org/licenses/by/4.0/
The gist: How deep does a graph neural network need to be on a sparse graph? We study its purest statistical form: node classification on the sparse contextual stochastic block model (CSBM) with average degree
Terminology
Abstract
How deep does a graph neural network need to be on a sparse graph? We study its purest statistical form: node classification on the sparse contextual stochastic block model (CSBM) with average degree =O(1), whose local weak limit is a broadcast-labelled Poisson Galton-Watson tree. Prior work derived a message-passing classifier h that aggregates from each vertex at distance k the attenuated evidence 2 artanh(gamma k t(X v)), with gamma the edge signal and t a bounded likelihood-ratio transform of the feature. We prove that the value of depth is governed by a single number, the Kesten-Stigum ratio kappa= gamma squared. Below the threshold (kappa<1), the error sequence is Cauchy at a geometric rate, E-E(') C kappa(+1)/3 for all '>, so all layers beyond depth O((1/epsilon)) change the error by less than epsilon; conversely, under mild regularity each sufficiently deep layer still flips the decision with probability at least c kappa/2, the empirically sharp exponent. Above the threshold (kappa>1), depth is geometrically productive: E is driven to a branching-process floor of order at most 1/(kappa-1) at any geometric rate kappa-s, s<1 (this bound has content only for kappa>17). No local classifier of any depth beats the universal floor e- (-zeta) set by isolated roots (zeta the feature signal-to-noise ratio), while the first layer provably helps by an explicit total-variation amount. Simulations with an exact belief-propagation baseline on the same trees show that the pairwise rule's error curve is mildly non-monotone in, so an optimal finite depth exists (an exact instance is certified in the appendix), while BP saturates strictly faster, at an effective per-layer ratio below kappa that we identify.
Sources
- Optimality of Message-Passing Architectures for Sparse Graphs
- Analysis of Corrected Graph Convolutions
Related papers
- Conformal Prediction for Dyadic Regression Under Complex Missingness
- Sharp Asymptotic Theory of Maximum Likelihood Estimation for Gaussian Processes with an RBF Kernel
- Bentkus-type asymptotic e-values
- High-Dimensional Asymptotics of Differentially Private PCA
- A proximal gradient algorithm for composite log-concave sampling
- KL Convergence Guarantees for Score diffusion models under minimal data assumptions