Query-based Submodular Data Selection for Efficient Instruction Tuning
cs.AI
Submitted: 2026-11-02
Updated: 2026-11-02
Terminology
Sources
- Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds
- Super-Samples from Kernel Herding
- Selection via Proxy: Efficient Data Selection for Deep Learning
- MoDS: Model-oriented Data Selection for Instruction Tuning
- Adversarial Active Learning for Deep Networks: a Margin Based Approach
- The Llama 3 Herd of Models
- Evaluation of Similarity-based Explanations
- Measuring Massive Multitask Language Understanding
- LoRA: Low-Rank Adaptation of Large Language Models
- Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2
- Large-Scale Data Selection for Instruction Tuning
- Active Learning by Acquiring Contrastive Examples
- A Critical Look at Targeted Instruction Selection: Disentangling What Matters (and What Doesn't)
- TRAK: Attributing Model Behavior at Scale
- Active Learning for Convolutional Neural Networks: A Core-Set Approach
- An Empirical Study of Example Forgetting during Deep Neural Network Learning
- Llama 2: Open Foundation and Fine-Tuned Chat Models
- Self-Consistency Improves Chain of Thought Reasoning in Language Models
- Finetuned Language Models Are Zero-Shot Learners
- The Best of Both Worlds: Bridging Quality and Diversity in Data Selection with Bipartite Graph
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents