Nonparametric Evaluation of Noisy ICA Solutions
Syamantak Kumar, Derek Bean, Peter J. Bickel, Purnamrita Sarkar
Abstract
Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source signals or the mixing process. While there are many sophisticated algorithms for estimation, different methods have different shortcomings. In this paper, we develop a nonparametric score to adaptively pick the right algorithm for ICA with arbitrary Gaussian noise. The novelty of this score stems from the fact that it just assumes a finite second moment of the data and uses the characteristic function to evaluate the quality of the estimated mixing matrix without any knowledge of the parameters of the noise distribution. In addition, we propose some new contrast functions and algorithms that enjoy the same fast computability as existing algorithms like FASTICA and JADE but work in domains where the former may fail. While these also may have weaknesses, our proposed diagnostic, as shown by our simulations, can remedy them. Finally, we propose a theoretical framework to analyze the local and global convergence properties of our algorithms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Related papers
- Feature learning from non-Gaussian inputs: the case of Independent Component Analysis in high dimensionsFabiola Ricci, Lorenzo Bardone, Sebastian GoldtICML 2025
- On the Identifiability of Sparse ICA without Assuming Non-GaussianityIgnavier Ng, Yujia Zheng, Xinshuai Dong, Kun ZhangNeurIPS 2023 · 9 citations
- A Normative and Biologically Plausible Algorithm for Independent Component AnalysisYanis Bahroun, Dmitri B. Chklovskii, Anirvan M. SenguptaNeurIPS 2021 · 16 citations
- Generalizing Nonlinear ICA Beyond Structural SparsityYujia Zheng, Kun ZhangNeurIPS 2023 · 39 citations
- Shared Independent Component Analysis for Multi-Subject NeuroimagingHugo Richard, Pierre Ablin, Bertrand Thirion, Alexandre Gramfort et al.NeurIPS 2021 · 14 citations
