Rethinking Dataset Distillation for Classification: Do Distilled Sets Outperform Coresets?
cs.LG
Submitted: 2026-06-16
Updated: 2026-11-03
Code: https://github.com/chuanyangjin/fast-DiT
Terminology
Sources
- LLaMA: Open and Efficient Foundation Language Models
- GPT-4 Technical Report
- ManifoldGD: Training-Free Hierarchical Manifold Guidance for Diffusion-Based Dataset Distillation
- The Evolution of Dataset Distillation: Toward Scalable and Generalizable Solutions
- Distilling the Knowledge in a Neural Network
- Coreset Selection via LLM-based Concept Bottlenecks
- Elucidating the Design Space of Dataset Condensation
- An Empirical Study of Example Forgetting during Deep Neural Network Learning
- Selection via Proxy: Efficient Data Selection for Deep Learning
- DD-Ranking: Rethinking the Evaluation of Dataset Distillation
- Rectified Decoupled Dataset Distillation: A Closer Look for Fair and Comprehensive Evaluation
- Unifying Dataset Pruning and Distillation for Efficient Large-scale Compression
- Coverage-centric Coreset Selection for High Pruning Rates
- ELFS: Label-Free Coreset Selection with Proxy Training Dynamics
- Active Learning for Convolutional Neural Networks: A Core-Set Approach
- MILO: Model-Agnostic Subset Selection Framework for Efficient Model Training and Tuning
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis