Shared Gaussianization: What Gaussian Regularizers Certify About Contrastive Learning, and What They Miss
cs.LG, stat.ML
Submitted: 2026-10-07
Updated: 2026-10-07
Comments: 27 pages, 4 figures, 3 tables. Ruoyu Zhao and Yuting Chen contributed equally; Tong Che is the project lead
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics
- InfoNCE Induces Gaussian Distribution
- An overview of uniformity tests on the hypersphere
- Beyond Isotropy in JEPAs: Hamiltonian Geometry and Symplectic Prediction
- When Does LeJEPA Learn a World Model?
- Understanding Self-Supervised Learning via Latent Distribution Matching
- SPHERE-JEPA: Spherical Prediction with Homogeneous Embeddings
- Expanding SPHERE-JEPA: A Family of Statistical Regularizers for the Hypersphere
- Beyond Gaussian Worlds: Latent Geometry Matters for JEPAs
- Unbiased Open World Regularization for Fair Self-Supervised Learning
- The Wristband Gaussian Loss: Deterministic, Composable Latents via a Sphere-Interval Decomposition
- Towards an Improved Understanding and Utilization of Maximum Manifold Capacity Representations
- Representation Learning with Contrastive Predictive Coding
- VISReg: Variance-Invariance-Sketching Regularization for JEPA training
- QQWorld: Quantile-Quantile Matching for World Model Regularization
- KerJEPA: Kernel Discrepancies for Euclidean Self-Supervised Learning
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks