When Does Tool Use Increase the Expressive Power of Finite-Precision Recurrent Models?
The study models finite-precision recurrent sequence models as controllers interacting with tools (or oracles). It finds a sharp divide: tools that are themselves finite-state add little expressivity, while a single unbounded tape tool grants Turing completeness. This is realized exactly by a specific type of one-layer selective affine state space model.