Gaussian Partial Information Decomposition: Bias Correction and Application to High-dimensional Data
Praveen Venkatesh, Corbett Bennett, Sam Gale, Tamina K. Ramirez, Greggory Heller, Severine Durand, Shawn R. Olsen, Stefan Mihalas
摘要
Recent advances in neuroscientific experimental techniques have enabled us to simultaneously record the activity of thousands of neurons across multiple brain regions. This has led to a growing need for computational tools capable of analyzing how task-relevant information is represented and communicated between several brain regions. Partial information decompositions (PIDs) have emerged as one such tool, quantifying how much unique, redundant and synergistic information two or more brain regions carry about a task-relevant message. However, computing PIDs is computationally challenging in practice, and statistical issues such as the bias and variance of estimates remain largely unexplored. In this paper, we propose a new method for efficiently computing and estimating a PID definition on multivariate Gaussian distributions. We show empirically that our method satisfies an intuitive additivity property, and recovers the ground truth in a battery of canonical examples, even at high dimensionality. We also propose and evaluate, for the first time, a method to correct the bias in PID estimates at finite sample sizes. Finally, we demonstrate that our Gaussian PID effectively characterizes inter-areal interactions in the mouse brain, revealing higher redundancy between visual areas when a stimulus is behaviorally relevant.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- Partial Information Decomposition via Normalizing Flows in Latent Gaussian DistributionsWenyuan Zhao, Adithya Balachandran, Chao Tian, Paul Pu LiangNeurIPS 2025 · 被引用 5 次
- Analytically deriving Partial Information Decomposition for affine systems of stable and convolution-closed distributionsChaitanya Goswami, Amanda MerkleyNeurIPS 2024 · 被引用 5 次
- SΩI: Score-based O-INFORMATION EstimationMustapha Bounoua, Giulio Franzese, Pietro MichiardiICML 2024 · 被引用 3 次
- Building Massively Multimodal Foundation Models with Interaction-aware Mixture-of-ExpertsXing Han, Hsing-Huan Chung, Joydeep Ghosh, Paul Pu Liang 等ICLR 2026 · 被引用 1 次
- Efficient Quantification of Multimodal Interaction at Sample LevelZequn Yang, Hongfa Wang, Di HuICML 2025
它引用的顶会 Paper2
- Estimating the Unique Information of Continuous VariablesAri Pakman, Amin Nejatbakhsh, Dar Gilboa, Abdullah Makkeh 等NeurIPS 2021 · 被引用 43 次
- An Information-Theoretic Quantification of Discrimination with Exempt FeaturesSanghamitra Dutta, Praveen Venkatesh, Piotr Mardziel, Anupam Datta 等AAAI 2020 · 被引用 34 次
相关 Paper
- Quantifying & Modeling Multimodal Interactions: An Information Decomposition FrameworkPaul Pu Liang, Yun Cheng, Xiang Fan, Chun Kai Ling 等NeurIPS 2023 · 被引用 120 次
- What should a neuron aim for? Designing local objective functions based on information theoryAndreas Christian Schneider, Valentin Neuhaus, David Alexander Ehrlich, Abdullah Makkeh 等ICLR 2025
- Demixed shared component analysis of neural population data from multiple brain areasYu Takagi, Steven W. Kennerley, Jun-ichiro Hirayama, Laurence T. HuntNeurIPS 2020 · 被引用 2 次
- Disentanglement Analysis with Partial Information DecompositionSeiya Tokui, Issei SatoICLR 2022 · 被引用 16 次
- Towards Understanding Modality Interaction in Multimodal Language Models via Partial Information DecompositionWanlong Fang, Tianle Zhang, Wen Tao, Alvin ChanICML 2026 · 被引用 17 次
