Replicability, Reproducibility, and Robustness in Political and Social Science Research with Large Language Models
cs.CL, cs.CY
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/llms-political-social-science-book-oup/book-code-data
Terminology
Sources
- Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotation
- Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks
- Auditing Political Alignment in LLM Assistants: Engagement, Stance, and User Identity
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data