A Survey of Bugs in AI-Generated Code
cs.SE, cs.AI
Submitted: 2025-12-04
Updated: 2026-11-16
Project page: https://pmd.github.io
Terminology
Sources
- GPT-4 Technical Report
- Program Synthesis with Large Language Models
- A Survey on Evaluating Large Language Models in Code Generation Tasks
- Evaluating Large Language Models Trained on Code
- Artificial-Intelligence Generated Code Considered Harmful: A Road Map for Secure and High-Quality Code Generation
- PanGu-Coder: Program Synthesis with Function-Level Language Modeling
- OpenAI o1 System Card
- DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence
- Assessing and Advancing Benchmarks for Evaluating Large Language Models in Software Engineering Tasks
- The Hitchhiker's Guide to Program Analysis: A Journey with Large Language Models
- CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis
- Code Llama: Open Foundation Models for Code
- Gemini: A Family of Highly Capable Multimodal Models
- Toward Secure Code Generation: Bridging Correctness and Security via Task-Adaptive Vulnerability Modeling and Execution-Based Benchmarking
- AICoderEval: Improving AI Domain Code Generation of Large Language Models
- Evaluating the Code Quality of AI-Assisted Code Generation Tools: An Empirical Study on GitHub Copilot, Amazon CodeWhisperer, and ChatGPT
- A Systematic Literature Review on Large Language Models for Automated Program Repair
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters