Active Learning with Imperfect Labels: Optimal Labeler Assignment and Sample Selection

arXiv:2512.12870 · cs.LG, cs.AI, math.OC · Submitted 2025-12-14 · Read on arXiv

cs.LG, cs.AI, math.OC

Submitted: 2025-12-14

Updated: 2026-09-30

Code: https://github.com/AhadiPouya/OLAS-Optimal-Labeler-Assignment-and39

Terminology

• Active Learning — 2× in this paper · explained in 6 episodes
• Accuracy — 1× in this paper · explained in 1 episode
• Benchmark — 1× in this paper · explained in 2 episodes

Sources

• Noisy Batch Active Learning with Deterministic Annealing
• Robust Assignment of Labels for Active Learning with Sparse and Noisy Annotations
• An Active Learning Approach for Jointly Estimating Worker Performance and Annotation Reliability with Crowdsourced Data

Related papers

• Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
• AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
• Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
• Convergence issues in Relational Concept Analysis based on AOC-posets
• Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
• Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks