TutorLoop: Regulating Student Learning Behaviors via Sensor-in-the-Loop Generative Feedback
cs.HC, cs.AI
Submitted: 2026-10-07
Updated: 2026-10-07
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: We present TutorLoop, a sensor-in-the-loop system that regulates student learning behaviors by delivering adaptive feedback based on real-time cognitive states.
Abstract
We present TutorLoop, a sensor-in-the-loop system that regulates student learning behaviors by delivering adaptive feedback based on real-time cognitive states. Unlike prior large language model (LLM) tutors that directly depend on scenario-specific content, TutorLoop operates on sensor-derived signals captured via webcams. Moreover, unlike direct cognitive-to-feedback mappings that are short-sighted, the system employs a deep reinforcement learning (DRL) agent to optimize the feedback type across the entire learning process. Finally, another LLM tutor refines feedback into human-like, context-aware messages. We evaluate TutorLoop in a large-scale user study (N=187), where a model trained offline is directly applied to a new learning task without retraining. Results show that TutorLoop provides less frequent yet more effective interventions, improving attention, reducing workload, increasing engagement, and ultimately enhancing learning outcomes. These findings highlight the potential of closed-loop, sensor-driven feedback for scalable human-AI integrated systems to support learning.
Sources
- OpenAI Gym
- AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors
- Adaptive and Personalized Exercise Generation for Online Language Learning
- SINKT: A Structure-Aware Inductive Knowledge Tracing Model with Large Language Model
- CGMI: Configurable General Multi-Agent Interaction Framework
- CLST: Cold-Start Mitigation in Knowledge Tracing by Aligning a Generative Language Model as a Students' Knowledge Tracer
- Language Model Can Do Knowledge Tracing: Simple but Effective Method to Integrate Language Model and Knowledge Tracing Task
- Learning Structure and Knowledge Aware Representation with Large Language Models for Concept Recommendation
- Integrating LSTM and BERT for Long-Sequence Data Analysis in Intelligent Tutoring Systems
- Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation
- Can LLMs Reliably Simulate Human Learner Actions? A Simulation Authoring Framework for Open-Ended Learning Environments
- A large language model-assisted education tool to provide feedback on open-ended responses
- Closing the Loop: Learning to Generate Writing Feedback via Language Model Simulated Student Revisions
- Proximal Policy Optimization Algorithms
- EduAgent: Generative Student Agents in Learning
- MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Education
- Simulating Classroom Education with LLM-Empowered Agents
Related papers
- Calibrating LLM Explanations to Human Decisions with Reinforcement Learning
- EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
- EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
- HAGI++: Head-Assisted Gaze Imputation and Generation
- Explanation User Interfaces: A Systematic Literature Review
- Hybrid Cinematography: Previsualizing and Managing Hallucination Risk in Generative Video Reshooting