Harness Evolution as Learning: Approximation, Generalization, and Optimization Limits of Self-Improving Personal Agents

arXiv:2609.36892 · cs.AI, cs.CL · Submitted 2026-09-29 · Read on arXiv

cs.AI, cs.CL

Submitted: 2026-09-29

Updated: 2026-09-29

Code: https://github.com/ZyGan1999/self-evolving-harness-as-learning

License: http://creativecommons.org/licenses/by/4.0/

The gist: As the capabilities of large language models (LLMs) continue to advance, increasing attention is turning to how to translate their abilities into useful behavior.

Terminology

Abstract

As the capabilities of large language models (LLMs) continue to advance, increasing attention is turning to how to translate their abilities into useful behavior. Personal agents bring this question into everyday settings, where models are expected to serve individual users and continually adapt to their preferences. With the underlying model held fixed, such adaptation relies on harness engineering: designing and evolving the surrounding layer that manages context, memory, tools, and execution. Despite rapid progress, the factors governing effective harness evolution remain insufficiently understood. To narrow this gap, we investigate three central questions concerning harness architecture, harness scale, and self-evolution algorithms through complementary empirical and theoretical analyses. Empirically, we introduce a preference-oriented benchmark and systematically characterize the capabilities and limitations of personal agents associated with these three dimensions. Theoretically, we formulate harness evolution as a learning problem and explain these phenomena through approximation, generalization, and optimization errors. Analyses of reachable policies, capacity under finite interaction evidence, and biased update dynamics provide theoretical accounts of the observed phenomena. Together, these results offer a unified perspective on the limits of personalization through harness evolution and inform future harness design.

Sources

Related papers