Gaussian BROJA Partial Information Decomposition in Closed Form
cs.IT, math.IT, stat.ML
Submitted: 2026-10-09
Updated: 2026-10-09
Comments: 28 pages total, including 10 pages of main text, 2 main figures, 5 supplementary sections, and 5 supplementary figures
Code: https://github.com/brainsandmachines/Eigen_PID
License: http://creativecommons.org/licenses/by/4.0/
The gist: The BROJA partial information decomposition provides an operationally motivated way to separate the information that two sources carry about a target into unique, redundant, and synergistic
Abstract
The BROJA partial information decomposition provides an operationally motivated way to separate the information that two sources carry about a target into unique, redundant, and synergistic components. For continuous and high-dimensional variables, however, computing the BROJA decomposition requires solving a difficult optimization problem. Previous work showed that, when each source-target pair is jointly Gaussian, the problem can be reduced to finite-dimensional numerical optimization. Here, we derive a closed-form solution to this optimization problem, enabling direct computation of the BROJA decomposition in the general multivariate Gaussian setting. The resulting closed-form expression enables speedups exceeding two orders of magnitude for high-dimensional Gaussian BROJA PID. Code is available at https://github.com/brainsandmachines/Eigen PID.
Sources
- Nonnegative Decomposition of Multivariate Information
- The Algonauts Project 2023 Challenge: How the Human Brain Makes Sense of Natural Scenes
Related papers
- Language Modeling is Monotone Compression
- Clipped Affine Policy: Low-Complexity Near-Optimal Online Power Control for Energy Harvesting Communications over Fading Channels
- Discrepancy for Random Linear Codes
- A New Approach to Code Smoothing Bounds
- Contextual Memory-Enhanced Source Coding for Low-SNR Communications
- Symmetry-Enforced Quadratic Approximate-Degradability Bounds for Noisy Landau-Streater Channels