Information decomposition of target effects from multi-source interactions: Perspectives on previous, current and future work

JT Lizier, N Bertschinger, J Jost, M Wibral - Entropy, 2018 - mdpi.com
The formulation of the Partial Information Decomposition (PID) framework by Williams and
Beer in 2010 attracted a significant amount of attention to the problem of defining redundant …

Measuring multivariate redundant information with pointwise common change in surprisal

RAA Ince - Entropy, 2017 - mdpi.com
The problem of how to properly quantify redundant information is an open question that has
been the subject of much recent research. Redundant information refers to information about …

Decomposing Multivariate Information Rates in Networks of Random Processes

L Sparacino, G Mijatovic, Y Antonacci, L Ricci… - arxiv preprint arxiv …, 2025 - arxiv.org
The Partial Information Decomposition (PID) framework has emerged as a powerful tool for
analyzing high-order interdependencies in complex network systems. However, its …

Pointwise partial information decompositionusing the specificity and ambiguity lattices

C Finn, JT Lizier - Entropy, 2018 - mdpi.com
What are the distinct ways in which a set of predictor variables can provide information about
a target variable? When does a variable provide unique information, when do variables …

Decomposing causality into its synergistic, unique, and redundant components

Á Martínez-Sánchez, G Arranz… - Nature …, 2024 - nature.com
Causality lies at the heart of scientific inquiry, serving as the fundamental basis for
understanding interactions among variables in physical systems. Despite its central role …

Temporal information partitioning: Characterizing synergy, uniqueness, and redundancy in interacting environmental variables

AE Goodwell, P Kumar - Water Resources Research, 2017 - Wiley Online Library
Abstract Information theoretic measures can be used to identify nonlinear interactions
between source and target variables through reductions in uncertainty. In information …

Partial information decomposition for continuous variables based on shared exclusions: Analytical formulation and estimation

DA Ehrlich, K Schick-Poland, A Makkeh, F Lanfermann… - Physical Review E, 2024 - APS
Describing statistical dependencies is foundational to empirical scientific research. For
uncovering intricate and possibly nonlinear dependencies between a single target variable …

A novel approach to the partial information decomposition

A Kolchinsky - Entropy, 2022 - mdpi.com
We consider the “partial information decomposition”(PID) problem, which aims to
decompose the information that a set of source random variables provide about a target …

[HTML][HTML] The partial information decomposition of generative neural network models

TMS Tax, PAM Mediano, M Shanahan - Entropy, 2017 - mdpi.com
In this work we study the distributed representations learnt by generative neural network
models. In particular, we investigate the properties of redundant and synergistic information …

Temporal Information Partitioning Networks (TIPNets): A process network approach to infer ecohydrologic shifts

AE Goodwell, P Kumar - Water Resources Research, 2017 - Wiley Online Library
In an ecohydrologic system, components of atmospheric, vegetation, and root‐soil
subsystems participate in forcing and feedback interactions at varying time scales and …