Patching the Protocol: A Taxonomy of Pre-Registration Repairs in LLM-Proposer Experiments
cs.AI, cs.SE
Submitted: 2026-11-03
Updated: 2026-11-03
Comments: 12 pages. Three-case study of protocol repairs in a pre-registered, LLM-proposer/verifier-gated program (production scheduling, incentive design, task assignment): each protocol needed exactly one defect-repair patch; a two-axis taxonomy and a verifiable non-impact claim for post-data repairs. Artifact archive: https://doi.org/10.5281/zenodo.23433826
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Evaluating Large Language Models Trained on Code
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- Preregistration for Experiments with AI Agents
- Mitigating LLM-based p-Hacking by Preregistering for the Next LLM
- The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents