Positional Encoding is All You Need for Scalable Equivariance Constraint Relaxation
cs.LG
Submitted: 2026-11-03
Updated: 2026-11-03
Code: https://github.com/hmichaeli/pe_constraint_relaxation
Terminology
Sources
- Improving Equivariant Model Training via Constraint Relaxation
- Recurrent Equivariant Constraint Modulation: Learning Per-Layer Symmetry Relaxation from Data
- Group Equivariant Convolutional Networks
- Learning Steerable Filters for Rotation Equivariant CNNs
- Invariant and Equivariant Graph Networks
- PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
- Vector Neurons: A General Framework for SO(3)-Equivariant Networks
- A Tale of Two Symmetries: Exploring the Loss Landscape of Equivariant Models
- Optimization Dynamics of Equivariant and Augmented Neural Networks
- Approximately Equivariant Networks for Imperfectly Symmetric Dynamics
- On Universality of Deep Equivariant Networks
- Relaxing Equivariance Constraints with Non-stationary Continuous Filters
- Learning Partial Equivariances from Data
- Approximately Equivariant Graph Networks
- Approximate Equivariance via Projection-based Regularisation
- Relaxed Equivariance via Multitask Learning
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networks
- Graph Neural Networks with Learnable Structural and Positional Representations
- Are Transformers universal approximators of sequence-to-sequence functions?
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis