Incremental Retrieval-Augmented Generation for Human-in-the-Loop Decision Support
cs.HC, cs.AI
Submitted: 2026-10-08
Updated: 2026-10-08
Code: https://github.com/FedericoMz/iRAG
License: http://creativecommons.org/licenses/by/4.0/
The gist: We introduce iRAG, a human-in-the-loop decision-support system combining Retrieval-Augmented Generation (RAG) with Hybrid Decision-Making.
Terminology
Abstract
We introduce iRAG, a human-in-the-loop decision-support system combining Retrieval-Augmented Generation (RAG) with Hybrid Decision-Making. Unlike conventional RAG systems, relying on static Knowledge Bases (KBs), our proposal addresses settings where the KB is initially empty and is progressively populated through human decisions. The system stores previous decisions as retrievable precedents and moves from silent observation to evidence-grounded contestation and, finally, to autonomous handling with abstention. Against an independent baseline, iRAG matches final-decision error under 10% drift without retrieval decay and reduces it under 40% drift across all configurations. Retrieval decay improves performance on changed knowledge while increasing error on stable knowledge, evidencing a stability--plasticity trade-off rather than a general advantage. Human oversight is an architectural provision of the workflow; its usability with real human users remains to be evaluated.
Sources
- Learning To Guide Human Decision Makers With Vision-Language Models
- Retrieval-Augmented Generation for Large Language Models: A Survey
- RAG Meets Temporal Graphs: Time-Sensitive Modeling and Retrieval for Evolving Knowledge
- Learning-to-defer for sequential medical decision-making under uncertainty
- AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems
- A Comprehensive Survey of Continual Learning: Theory, Method and Application
- Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models
Related papers
- Calibrating LLM Explanations to Human Decisions with Reinforcement Learning
- EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
- EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
- HAGI++: Head-Assisted Gaze Imputation and Generation
- Explanation User Interfaces: A Systematic Literature Review
- Hybrid Cinematography: Previsualizing and Managing Hallucination Risk in Generative Video Reshooting