Large-scale Repository Engineering via Agent-Native Reusable Code Primitives
cs.SE, cs.CL, cs.CV
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: 44 pages
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models equipped with development environments have moved code generation toward repository-scale construction, yet building complete repositories remains difficult because interacting
Abstract
Large language models equipped with development environments have moved code generation toward repository-scale construction, yet building complete repositories remains difficult because interacting modules, interfaces, configurations, tests, and dependencies must work together. We introduce Code Primitives, agent-native reusable executable components with interface contracts, dependency closures, validation tests, and provenance. Each primitive uses a resident LLM to assess relevance and adapt its implementation, interfaces, and dependencies to the target repository, and we organize 1,424 validated primitives in CodeFace, a searchable library for repository construction. We introduce LEGO (Large-scale repository Engineering via aGent-native reusable cOde primitives), which activates task-relevant primitives, integrates their adapted implementations with task-specific code while resolving cross-component constraints, and revises the result against executed tests. To measure construction end to end, we build LEGO-REPO, a benchmark of 522 executable reconstruction tasks spanning seven software domains, 22 capability tracks, and five difficulty levels, scored against native test suites between an empty-package floor and original-source ceiling. The strongest of 13 evaluated backbones reaches a delivery score of 0.318 and scores zero on 41.0% of tasks; LEGO improves all 13 by 0.1474 on average and raises GPT-5.6-terra from 0.3180 to 0.5134 (+61.4%). In controlled comparisons, adapted primitives outperform retrieved code supplied as context or vendored unchanged. The effect persists against independent repository agents, across three external benchmarks, and with a disjointly re-mined CodeFace; GPT-OSS-20B for adaptation and diagnosis retains 95.1% of the homogeneous score at 24.0% lower cost.
Sources
- Program Synthesis with Large Language Models
- CodeT: Code Generation with Generated Tests
- Evaluating Large Language Models Trained on Code
- NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
- Measuring Coding Challenge Competence With APPS
- Agent Primitives: Reusable Latent Building Blocks for Multi-Agent Systems
- Harness Engineering in LLM Tool Use via Agent-Native Reusable Tool Primitives
- SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios
- CODESKILL: Learning Self-Evolving Skills for Coding Agents
- RepoGenesis: Benchmarking End-to-End Microservice Generation from Readme to Repository
- AgentDistill: Training-Free Agent Distillation with Generalizable MCP Boxes
- ReGAL: Refactoring Programs to Discover Generalizable Abstractions
- TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Tasks
- Agentless: Demystifying LLM-based Software Engineering Agents
- RepoZero: Can LLMs Generate a Code Repository from Scratch?
- DocPrompting: Generating Code by Retrieving the Docs
Related papers
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- SABER: Benchmarking Operational Safety of LLM Coding Agents in Stateful Project Workspaces
- PackMonitor: Enabling Zero Package Hallucinations Through Decoding-Time Monitoring
- IntentCoding: Amplifying User Intent in Code Generation
- Incentives and Outcomes in Bug Bounties