Adapting LLM Judges to Observed Human Annotation Policy through Soft Prompt Tuning
cs.CL, cs.AI
Submitted: 2026-11-04
Updated: 2026-11-04
Terminology
Sources
- Beyond Prompt and Parser Engineering: Soft-Prompt Tuning for Automated LLM Evaluation
- The Llama 3 Herd of Models
- ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection
- Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment
- Qwen3 Technical Report
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data