On the Multi-Index, Multi-Rate, and Multi-Phase Dynamics of Decoder-Only Language Models: A Unified Hybrid Framework for Generative and Agentic Systems
The paper models decoder-only language models as a multi-index, multi-rate system to better understand agentic tool interaction. It treats the model's complex architecture as having three different time scales and two operational modes, allowing for a stochastic hybrid systems framework to govern how the model generates text and interacts with external tools.