Understanding What TRAK Gets Right and Wrong: A Theory of Data Attribution
cs.LG
Submitted: 2026-02-01
Updated: 2026-11-09
Terminology
Sources
- Simfluence: Modeling the Influence of Individual Training Examples by Simulating Training Runs
- Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functions
- A Short Note on Concentration Inequalities for Random Vectors with SubGaussian Norm
- Data Shapley in One Training Run
- LESS: Selecting Influential Data for Targeted Instruction Tuning
- Cognitive Mirage: A Review of Hallucinations in Large Language Models
Related papers
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis
- (Mis)generalization of Helpful-Only Fine-tuning