TwinS-GCN: Spectral conjugate for Spectral Graph Convolutional Networks
cs.LG, cs.AI
Submitted: 2026-09-26
Updated: 2026-09-26
Code: https://github.com/bingzhewei/geom-gcn
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Graph convolutional networks propagate information by repeated local aggregation through a graph shift operator; i.e., a K-layer network reaches K hops neighborhood.
Terminology
Abstract
Graph convolutional networks propagate information by repeated local aggregation through a graph shift operator; i.e., a K-layer network reaches K hops neighborhood. On the one hand, such spreading can lead to oversmoothing. On the other hand, long-range dependencies demand the depth. Transporting information on long distances and without attenuation requires the shift to distinguish a direction of flow, which a symmetric operator cannot perform but a directed one can fulfill. A natural way to extract pure-directionality is to take the skew-symmetric part of the shift operator through the Cartesian split, which, however, generally does not commute with the shift itself, meaning that the filters built on it are not shift-invariant. We instead use the spectral conjugate; i.e., the image of the operator under τ:z, which commutes with the shift and splits it into a dissipative and a non-dissipative part. Two filter families follow: a sum filter, whose non-dissipative component transports signal without energy loss, and a ratio filter, ratio in the pair of components rather than polynomial in the shift. Both arise from non-holomorphic kernels, placing them outside the holomorphic class underlying classical spectral convolution. On the directed cycle, the ratio filter becomes an IIR filter with global impulse response, for which we prove a long-range reach gap against every degree- K polynomial filter. Chebyshev reparameterization gives stable vertex-domain layers with real coefficients, yielding TwinS-GCN, which solves graph transfer tasks at reduced depth and is competitive with state-of-the-art graph convolutional networks on node classification benchmarks.
Sources
- Geometry-Induced Diffusion on Graphs: A Learnable Weighted Laplacian for Spectral GNNs
- How Attentive are Graph Attention Networks?
- Graph Diffusion-Advection Operator for Directed Graph Signal Processing
- A tutorial on automatic differentiation with complex numbers
- A critical look at the evaluation of GNNs under heterophily: Are we really making progress?
- A Survey on Oversmoothing in Graph Neural Networks
- Supercharging Graph Transformers with Advective Diffusion
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks