Gaussian BROJA Partial Information Decomposition in Closed Form

arXiv:2610.13464 · cs.IT, math.IT, stat.ML · Submitted 2026-10-09 · Read on arXiv

cs.IT, math.IT, stat.ML

Submitted: 2026-10-09

Updated: 2026-10-09

Comments: 28 pages total, including 10 pages of main text, 2 main figures, 5 supplementary sections, and 5 supplementary figures

Code: https://github.com/brainsandmachines/Eigen_PID

License: http://creativecommons.org/licenses/by/4.0/

The gist: The BROJA partial information decomposition provides an operationally motivated way to separate the information that two sources carry about a target into unique, redundant, and synergistic

Abstract

The BROJA partial information decomposition provides an operationally motivated way to separate the information that two sources carry about a target into unique, redundant, and synergistic components. For continuous and high-dimensional variables, however, computing the BROJA decomposition requires solving a difficult optimization problem. Previous work showed that, when each source-target pair is jointly Gaussian, the problem can be reduced to finite-dimensional numerical optimization. Here, we derive a closed-form solution to this optimization problem, enabling direct computation of the BROJA decomposition in the general multivariate Gaussian setting. The resulting closed-form expression enables speedups exceeding two orders of magnitude for high-dimensional Gaussian BROJA PID. Code is available at https://github.com/brainsandmachines/Eigen PID.

Sources

Related papers