SoScale: Second-Order Scale Search for FP4 Quantization
cs.LG, cs.AI
Submitted: 2026-11-12
Updated: 2026-11-12
Terminology
Sources
- QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Training Verifiers to Solve Math Word Problems
- Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling
- Bridging the Gap Between Promise and Performance for Microscaling FP4 Quantization
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
- Search Your Block Floating Point Scales!
- SpinQuant: LLM quantization with learned rotations
- HiFloat4 Format for Language Model Inference
- ARCQuant: Boosting NVFP4 Quantization with Augmented Residual Channels for LLMs
- Pointer Sentinel Mixture Models
- Microscaling Data Formats for Deep Learning
- Block Rotation is All You Need for MXFP4 Quantization
- Qwen3 Technical Report
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis