An Information Theory of Finite Abstractions and their Fundamental Scalability Limits
The work develops a statistical theory linking abstraction size and accuracy using rate-distortion theory. It treats abstractions as encoder-decoder pairs for dynamical systems, deriving fundamental lower bounds on achievable distortion given system dynamics and abstraction size, and vice versa. This establishes limits on how large or accurate an abstraction can be for a given system.