Self-Supervised Collapse Prevention with Score-Based Entropy Maximization
cs.LG
Submitted: 2026-11-08
Updated: 2026-11-08
Terminology
Sources
- LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics
- Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representations
- V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learning
- VISReg: Variance-Invariance-Sketching Regularization for JEPA training
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis