Adaptive Pluralistic Alignment: A pipeline for dynamic artificial democracy
The Adaptive Pluralistic Alignment (APA) pipeline updates AI systems to track changing values without costly retraining. It personalizes reward models cheaply, uses a jury of these models for democratic voting, and adapts the system by only learning new user preferences. This makes value alignment dynamic, auditable, and robust against lock-in.