LibEvoBench: Probing Temporal Knowledge Stratification in Code Generation Models
cs.SE, cs.AI
Submitted: 2026-06-24
Updated: 2026-11-07
Code: https://github.com/pytorch/pytorch
Terminology
Sources
- Long Code Arena: a Set of Benchmarks for Long-Context Code Models
- Towards Mitigating API Hallucination in Code Generated by LLMs with Hierarchical Dependency Aware
- Gemini: A Family of Highly Capable Multimodal Models
- On Mitigating Code LLM Hallucinations with API Documentation
- LibEvolutionEval: A Benchmark and Study for Version-Specific Code Generation
- Do Developers Update Their Library Dependencies? An Empirical Study on the Impact of Security Advisories on Library Migration
- Beyond Functional Correctness: Exploring Hallucinations in LLM-Generated Code
- StarCoder 2 and The Stack v2: The Next Generation
- GitChameleon 2.0: Evaluating AI Code Generation Against Python Library Version Incompatibilities
- We Have a Package for You! A Comprehensive Analysis of Package Hallucinations by Code Generating LLMs
- Qwen3.5-Omni Technical Report
- CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based Verification
- LLMs Meet Library Evolution: Evaluating Deprecated API Usage in LLM-based Code Completion
- TIME: A Multi-level Benchmark for Temporal Reasoning of LLMs in Real-World Scenarios
- VersiCode: Towards Version-controllable Code Generation
- LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigation
- Set the Clock: Temporal Alignment of Pretrained Language Models
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters