From Knowledge Access to Source Learning: Developing Source-Specific Competence
cs.CL, cs.AI, cs.LG
Submitted: 2026-10-01
Updated: 2026-10-01
Comments: Website: https://sourcelearn.github.io/ Code: https://github.com/luchengfu6/SourceLearn
Code: https://github.com/luchengfu6/SourceLearn
Project page: https://sourcelearn.github.io
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Large language model (LLM) agents increasingly rely on persistent external sources to solve sequences of knowledge-intensive tasks.
Terminology
Abstract
Large language model (LLM) agents increasingly rely on persistent external sources to solve sequences of knowledge-intensive tasks. Existing methods improve how source content is accessed and organized, while agent-memory systems preserve reusable knowledge from prior interactions, but repeated use of the same source is still largely treated as repeated access rather than an opportunity to progressively improve understanding of that source. We study source learning: developing reusable source-specific competence over a persistent authoritative source. We represent this competence with a persistent source model that captures reusable understanding of the source, including how its knowledge is structured, interpreted, and applied. To construct and progressively refine such models, we propose SourceLearn, which combines two complementary learning mechanisms. Self-Directed Source Learning identifies what remains incompletely understood and adaptively revisits the source, while Task-Guided Source Learning uses downstream experience to reveal local representational gaps and recurring needs in how source knowledge should be organized. In both cases, learning signals determine what should be reconsidered, while persistent updates are reconstructed from the authoritative source. Across five benchmarks and three LLM backends, SourceLearn achieves the best performance in 13 of 15 settings, with gains of up to 22.6 points over Hybrid RAG and substantial overall improvements over static source representations and experience-based memory baselines.
Sources
- From Local to Global: A Graph RAG Approach to Query-Focused Summarization
- Corrective Retrieval Augmented Generation
- Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memory
- MemGPT: Towards LLMs as Operating Systems
- gpt-oss-120b & gpt-oss-20b Model Card
- DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering