Metric-Dependent Annotation Saturation for Learning from Label Distributions
cs.CL
Submitted: 2026-05-28
Updated: 2026-10-29
Comments: Accepted at the 1st PANDORA Workshop (Pluralistic AI & NLP) at EMNLP 2026
Journal ref: Proceedings of the First Workshop on Pluralistic AI NLP: Diversity-aware, Sociotechnical, Responsible Alignment (PANDORA 2026), pages 88-104, Association for Computational Linguistics, Budapest, Hungary
DOI: 10.18653/2026.pandora-1.4
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Distributions In, Distributions Out: The Case for Soft-Label Training
- Capturing Label Distribution: A Case Study in NLI
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data