Refusing the Impossible: A Taxonomy and Benchmark for Code Hallucination in Large Language Models
cs.SE
Submitted: 2026-09-03
Updated: 2026-10-31
Code: https://github.com/vdasu/code_hallucination
Terminology
Sources
- CodeMirage: Hallucinations in Code Generated by Large Language Models
- Program Synthesis with Large Language Models
- Evaluating Large Language Models Trained on Code
- Why Language Models Hallucinate
- Hallucination by Code Generation LLMs: Taxonomy, Benchmarks, Mitigation, and Challenges
- Beyond Functional Correctness: Exploring Hallucinations in LLM-Generated Code
- GPT-4 Technical Report
- Code Hallucination
- Library Hallucinations in LLM-Generated Code: A Risk Analysis Grounded in Developer Queries
- Do Large Language Models Know What They Don't Know?
- Recognizing Limits: Investigating Infeasibility in Large Language Models
- LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigation
- ImpossibleBench: Measuring LLMs' Propensity of Exploiting Test Cases
- Identifying and Mitigating API Misuse in Large Language Models
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters