Axiom Satisfiability of Linear Rewards in Alignment

arXiv:2610.06892 · cs.GT, cs.AI, cs.LG, cs.MA · Submitted 2026-09-26 · Read on arXiv

cs.GT, cs.AI, cs.LG, cs.MA

Submitted: 2026-09-26

Updated: 2026-09-26

Code: https://github.com/Itachi1999/ai_alignment_linear_model_extension

Project page: https://preflib.github.io/PrefLib-Jekyll/dataset/00070

Terminology

• Alignment — 1× in this paper · explained in 1 episode

Sources

• Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
• Social Choice Should Guide AI Alignment in Dealing with Diverse Human Feedback
• Mapping Social Choice Theory to RLHF
• The Representation-Rationalizability Tradeoff in Reward Learning
• Theoretical Tensions in RLHF: Reconciling Empirical Success with Inconsistencies in Social Choice Theory

Related papers

• Exact Regret Frontiers and Externality Scheduling in Centralized Serial-Dictatorship Bandits
• In-Context Credit Assignment via the Core
• Optimal Regret for Online Market Making with Limit Order Book
• Breaking 1/epsilon Barrier in Quantum Zero-Sum Games: Generalizing Metric Subregularity for Spectraplexes
• Enhancing Affine Maximizer Auctions with Correlation-Aware Payment
• LLM Bidders Preserve the Mechanism-Level Orderings of Human Bidders