Subspace Node Pruning
cs.LG, cs.CV, cs.NE
Submitted: 2024-05-26
Updated: 2026-11-03
Code: https://github.com/facebookresearch/fvcore
Terminology
Sources
- Correlations Are Ruining Your Gradient Descent
- SliceGPT: Compress Large Language Models by Deleting Rows and Columns
- Layer-compensated Pruning for Resource-constrained Convolutional Neural Networks
- Quantizing deep convolutional networks for efficient inference: A whitepaper
- Pruning Filters for Efficient ConvNets
- Greedy Output Approximation: Towards Efficient Structured Pruning for LLMs Without Retraining
- Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizations
- Diversity Networks: Neural Network Compression Using Determinantal Point Processes
- Pointer Sentinel Mixture Models
- Pruning Convolutional Neural Networks for Resource Efficient Inference
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- CP-ViT: Cascade Vision Transformer Pruning via Progressive Sparsity Prediction
- Faster gaze prediction with dense networks and Fisher pruning
- Towards Meta-Pruning via Optimal Transport
- Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning
- HuggingFace's Transformers: State-of-the-art Natural Language Processing
- Unified Visual Transformer Compression
- OPT: Open Pre-trained Transformer Language Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis