AI Alignment Is Neither Solvable nor Sufficient
cs.AI
Submitted: 2026-11-09
Updated: 2026-11-09
Terminology
Sources
- AI Agents May Always Fall for Prompt Injections
- No Certificate for Alignment: Two Independent Impossibilities and the Pareto Frontier of Achievable Safety Guarantees
- Foundational Challenges in Assuring Alignment and Safety of Large Language Models
- Constitutional AI: Harmlessness from AI Feedback
- Position: Safety and Fairness in Agentic AI Depend on Interaction Topology, Not on Model Scale or Alignment
- Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation
- Position: The Alignment Community is Unintentionally Building a Censor's Toolkit
- LEMON: Equivariant Learning over Attention Maps for Zero-Shot Misbehavior Monitoring on New LLMs
- Rewarded for Not Getting Caught: Why Alignment Training Selects for Conditional Compliance and Cannot Instill Norms
- Managing extreme AI risks amid rapid progress
- RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents
- The Coming Crisis of Multi-Agent Misalignment: AI Alignment Must Be a Dynamic and Social Process
- AI Alignment with Changing and Influenceable Reward Functions
- Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback
- Constitutional Classifiers++: Efficient Production-Grade Defenses against Universal Jailbreaks
- Open Problems in Cooperative AI
- Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems
- Conformity Generates Collective Misalignment in AI Agents Societies
- Models That Know How Evaluations Are Designed Score Safer
- Impossibility and Uncertainty Theorems in AI Value Alignment (or why your AGI should not have a utility function)
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents