Rational Sparse Autoencoder
cs.LG, cs.AI
Submitted: 2026-06-12
Updated: 2026-11-19
Terminology
Sources
- BatchTopK Sparse Autoencoders
- Learning Multi-Level Features with Matryoshka Sparse Autoencoders
- Rational Neural Networks for Approximating Jump Discontinuities of Graph Convolution Operator
- Adaptive Rational Activations to Boost Deep Reinforcement Learning
- Pad'e Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks
- Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoders
- Rational Neural Networks have Expressivity Advantages
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis