The Model as One Rater Among Several: Measuring Political Positions in Data-Sparse Regions with a Language-Model Panel
cs.CY, cs.AI, cs.CL, stat.AP
Submitted: 2026-06-22
Updated: 2026-10-27
Comments: 14 pages, 2 figures, 7 tables. v2: corrects an import error that had attached 154 of one model's ratings to the wrong parties; every figure recomputed from the corrected v1.0 data release; two-column layout
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- ChatGPT-4 Outperforms Experts and Crowd Workers in Annotating Political Twitter Messages with Zero-Shot Learning
- Automated Annotation with Generative AI Requires Validation
- Large Language Models Can Be Used to Estimate the Latent Positions of Politicians
- Positioning Political Texts with Large Language Models by Asking and Averaging
- Towards Measuring the Representation of Subjective Global Opinions in Language Models
Related papers
- AI-Mediated Communication Can Steer Collective Opinion
- Epistemic Infrastructures of Science in AI Era Should Rebalance Costs of Generation and Verification
- AI out-persuades expert humans in text-based dialogue
- Evaluating Ambient Clinical Scribes in India: The Need for Multilingual Real-World Clinical Conversation Data
- AI Value Alignment for Evolving Social Norms
- Voting Biases in Decentralized Autonomous Organization (DAO) Governance