Rethinking Data Selection as Distribution Matching on Semantic Manifolds
cs.LG, cs.CL
Submitted: 2026-08-05
Updated: 2026-08-05
Terminology
Sources
- SemDeDup: Data-efficient learning at web-scale through semantic deduplication
- Qwen3-VL Technical Report
- Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
- PRISM: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selection
- AlpaGasus: Training A Better Alpaca with Fewer Data
- Evaluating Large Language Models Trained on Code
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Training Verifiers to Solve Math Word Problems
- FisherSFT: Data-Efficient Supervised Fine-Tuning of Language Models Using Information Gain
- Why Less is More (Sometimes): A Theory of Data Curation
- The Llama 3 Herd of Models
- Learning from the Best, Differently: A Diversity-Driven Rethinking on Data Selection
- Measuring Massive Multitask Language Understanding
- Measuring Mathematical Problem Solving With the MATH Dataset
- DONOD: Efficient and Generalizable Instruction Fine-Tuning for LLMs via Model-Intrinsic Dataset Pruning
- Exploring Learning Complexity for Efficient Downstream Dataset Pruning
- Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Ranking
- #InsTag: Instruction Tagging for Analyzing Supervised Fine-tuning of Large Language Models
- Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoning
- MLLM-Selector: Necessity and Diversity-driven High-Value Data Selection for Enhanced Visual Instruction Tuning
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis