Chronos Enables Code Agents to Reason over Software Evolution
cs.SE, cs.CL
Submitted: 2026-10-08
Updated: 2026-10-08
Comments: 22 pages, 3 figures
License: http://creativecommons.org/licenses/by/4.0/
The gist: Historical pull requests record the design decisions, compatibility constraints, and implementation patterns behind a codebase's current state.
Terminology
Abstract
Historical pull requests record the design decisions, compatibility constraints, and implementation patterns behind a codebase's current state. Experience relevant to a new task can span related changes whose descriptions emphasize different concerns. We introduce Chronos, a test-time framework that makes this connected history available to large language model (LLM)-based code agents. Chronos distills merged pull requests into structured experience cards and connects them through a typed graph of code-level, developer-intent, and organizational relations. Semantic search identifies entry cards, and weighted multi-hop expansion retrieves connected changes for selective reading. The same memory guides candidate generation and patch selection: a patch-focused change agent and a validation-strategy agent each develop a patch, and an evolution steward consults history to select between them. On SWE-Bench Verified, the full workflow improves SWE-Agent across all six evaluated LLM backbones, raising the mean resolution rate from 69.2% to 72.9% and reaching 79.8% with MiniMax M2.5. With the same backbone, it raises resolution rates from 48.3% to 51.7% on SWE-Bench Pro and from 41.0% to 43.5% on FEA-Bench Lite. Both experience-guided single-agent variants also outperform the base agent. In a human evaluation on 100 tasks with ten cards retrieved per task, graph-grounded retrieval increases the mean number of useful cards from 1.24 to 2.87 over flat semantic retrieval. These results demonstrate the value of PR relations for retrieving useful repository experience and of the evaluated workflows for applying that experience during patch generation and selection.
Sources
- SWE-Exp: Experience-Driven Software Issue Resolution
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
- Your Code Agent Can Grow Alongside You with Structured Memory
- From Local to Global: A Graph RAG Approach to Query-Focused Summarization
- Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scaling
- Kimi k1.5: Scaling Reinforcement Learning with LLMs
- MigrationBench: Repository-Level Code Migration Benchmark from Java 8
- GraphCoder: Enhancing Repository-Level Code Completion via Code Context Graph-based Retrieval and Language Model
- G-RAG: Knowledge Expansion in Material Science
- EXPEREPAIR: Dual-Memory Enhanced LLM-based Repository-Level Program Repair
- MemGPT: Towards LLMs as Operating Systems
- SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents
- HAFix: History-Augmented Large Language Models for Bug Fixing
- CodeTaste: Can LLMs Generate Human-Level Code Refactorings?
- Improving Code Localization with Repository Memory
- Voyager: An Open-Ended Embodied Agent with Large Language Models
- MemGovern: Enhancing Code Agents through Learning from Governed Human Experiences
- SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution
- Lingxi: Repository-Level Issue Resolution Framework Enhanced by Procedural Knowledge Guided Scaling
- FeatureBench: Benchmarking Agentic Coding for Complex Feature Development
Related papers
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- SABER: Benchmarking Operational Safety of LLM Coding Agents in Stateful Project Workspaces
- PackMonitor: Enabling Zero Package Hallucinations Through Decoding-Time Monitoring
- IntentCoding: Amplifying User Intent in Code Generation
- Incentives and Outcomes in Bug Bounties