Reels-RSI: Program-Level Self-Improvement for Code-Rendered Explainer Videos
cs.AI, cs.GR, cs.MM, cs.SE
Submitted: 2026-10-10
Updated: 2026-10-10
Comments: 19 pages, 4 figures, 9 tables. Code, rules, lessons, data and evolve reports: https://github.com/agentic-loops-x/Reels-RSI
Code: https://github.com/agentic-loops-x/Reels-RSI
License: http://creativecommons.org/licenses/by/4.0/
The gist: Explainer videos -- a worked geometry problem, why the sky is blue, how a dynasty fell -- are usually one more target for pixel video generation.
Abstract
Explainer videos -- a worked geometry problem, why the sky is blue, how a dynasty fell -- are usually one more target for pixel video generation. We argue they are a different kind of artifact: a program (script, storyboard and per-frame animation code) that a deterministic renderer turns into frames. A program can be read, diffed, tested and audited; pixels can only be watched. Reels-RSI is an open-source reel director for any agent harness; its self-improvement happens at the program level rather than in weights or prompts. Every revision pass is logged with a code snapshot; a retrospective pairs each check finding with the diff that fixed it and proposes lessons; a lesson that a static check can catch is compiled into a rule with a must-fail and a must-pass example, so the memory is unit-tested; and a rule learned today runs over everything made before it. A bounded, benchmark-gated step lets an agent rewrite the director's playbook, kept only when blind pairwise judgments on held-out topics prefer it; nothing enters memory without a human decision. Across 111 reels -- a field study, two playbook evolutions, a 2x2 memory ablation, a weaker director, a 48-reel learning curve and a judge-reliability study -- we find that the rule learned in the field caught four latent defects in frames authored before it existed and none after; that rules are an audit for a strong director (eight unguarded reels, no violation) and a guard for a weaker one (thirty violations unguarded versus five); that lessons shorten revision loops but do not compound or move the judge; and that the first rewrite's 11--1 verdict was a position bias in our vote design (judges pick the second-shown reel 62--81% of the time), masking scripts that traded thirteen facts for craft. We document four failure modes of the preference signal, which check caught each, and the fixes. Code, rules, lessons and data are public.
Sources
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
- Code2Video: A Code-centric Paradigm for Educational Video Generation
- Automated Design of Agentic Systems
- ManimAgent: Self-Evolving Multimodal Agents for Visual Education
- TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understanding
- Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agents
- Write Your Own CodeChecker: An Automated Test-Driven Checker Development Approach with LLMs
- CineForge: Self-Improving Agents for Long-Horizon Video Generation
- SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
- Reflexion: Language Agents with Verbal Reinforcement Learning
- LLM-as-a-Judge Is Not an Oracle: Why Self-Improving Agents Need Deterministic Guardrails
- Voyager: An Open-Ended Embodied Agent with Large Language Models
- Inducing Programmatic Skills for Agentic Tasks
- VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation
- Aligning Progress and Feasibility: A Neuro-Symbolic Dual Memory Framework for Long-Horizon LLM Agents
- KNighter: Transforming Static Analysis with LLM-Synthesized Checkers
- On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecification
- Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
- Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models
- ExpeL: LLM Agents Are Experiential Learners
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems