When Does Tool Use Increase the Expressive Power of Finite-Precision Recurrent Models?

The study models finite-precision recurrent sequence models as controllers interacting with tools (or oracles). It finds a sharp divide: tools that are themselves finite-state add little expressivity, while a single unbounded tape tool grants Turing completeness. This is realized exactly by a specific type of one-layer selective affine state space model.

Open the full episode

More from AI Radio