Do They Do as They Are Told? Investigating Coding Agents' Adherence to Explicit Instructions in Context Files
cs.SE
Submitted: 2026-11-10
Updated: 2026-11-10
Code: https://github.com/gianwario/Agents-Context-Files-Analysis
Terminology
Sources
- CodeT: Code Generation with Generated Tests
- Harness Engineering for Agentic AI Coding Tools: An Exploratory Study
- Evaluating AGENTS.md: Are Repository-Level Context Files Helpful for Coding Agents?
- Agentic Software Engineering: Foundational Pillars and a Research Roadmap
- Agentic Refactoring: An Empirical Study of AI Coding Agents
- Professional Software Developers Don't Vibe, They Control: AI Agent Use for Coding in 2025
- The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering
- On the Impact of AGENTS.md Files on the Efficiency of AI Coding Agents
- Context Engineering for AI Agents in Open-Source Software
- Assessing the Quality and Security of AI-Generated Code: A Quantitative Analysis
- Are LLMs Correctly Integrated into Software Systems?
- CodeIF-Bench: Evaluating Instruction-Following Capabilities of Large Language Models in Interactive Code Generation
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters