Nonequivalence of expected free energy and revised system integrated information in noisy permutation networks
q-bio.NC, cond-mat.stat-mech
Submitted: 2026-09-15
Updated: 2026-09-15
Comments: 14 pages, 4 figures
License: http://creativecommons.org/licenses/by/4.0/
The gist: The free-energy principle (FEP) and active inference describe adaptive systems through probabilistic generative models and free-energy functionals, whereas integrated information theory (IIT)
Abstract
The free-energy principle (FEP) and active inference describe adaptive systems through probabilistic generative models and free-energy functionals, whereas integrated information theory (IIT) characterizes intrinsic cause-effect organization. We separate two questions: whether revised IIT quantities admit local free-energy-like representations and whether scalar expected free energy can determine system integrated information. We show that the 2026 IIT intrinsic-differentiation and specification terms admit exact surprisal representations, and hence variational-free-energy representations under exact inference. We then construct noisy binary permutation networks whose causal topology varies while local transition reliability is fixed. In a homogeneous state, all permutations yield the same one-step predictive distribution and state-risk expected free energy under common preferences and observation models, yet revised IIT distinguishes them: multicycle permutations have zero whole-system integration, whereas a single noisy cycle has positive integration at intermediate reliability. For an n-unit noisy single cycle, we derive a closed-form expression for revised system integrated information, prove that the minimum-information partition cuts exactly two causal edges, and show that as n grows the optimal reliability approaches unity, the joint specified-state probability approaches one half, and the maximum integration approaches one ibit. Numerical IIT calculations for n = 2-5 and exhaustive partition enumeration through n = 8 reproduce the analytical results. Thus, local surprisal/free-energy correspondence coexists with global non-equivalence: equal expected free energy does not imply equal revised IIT system integrated information. Any synthesis of IIT with FEP/active inference must retain counterfactual causal information beyond a scalar free-energy value.
Sources
- Mutual Information in Coupled Double Quantum Dots: A Simple Analytic Model for Potential Artificial Consciousness
- Bridging integrated information theory and the free-energy principle in living neuronal networks
- Information as Maximum-Caliber Deviation: A bridge between Integrated Information Theory and the Free Energy Principle
Related papers
- BrainWave: A Brain Signal Foundation Model for Clinical Applications
- Toward Robust, Reproducible, and Widely Accessible Intracranial Speech Brain-Computer Interfaces: A Comprehensive Narrative Review of Neural Mechanisms, Hardware, Algorithms, Evaluation, Clinical Pathways and Future Directions
- CytoNet: A Foundation Model for the Human Cerebral Cortex at Cellular Resolution
- Decoding Alignment without Encoding Alignment: A critique of similarity analysis in neuroscience
- Emergence of psychopathological computations in large language models
- NeuroAI and Beyond: Bridging Between Advances in Neuroscience and Artificial Intelligence