Consistent Estimation of Identifiable Nonparametric Mixture Models from Grouped Observations
Alexander Ritchie, Robert A. Vandermeulen, Clayton D. Scott
Abstract
Recent research has established sufficient conditions for finite mixture models to be identifiable from grouped observations. These conditions allow the mixture components to be nonparametric and have substantial (or even total) overlap. This work proposes an algorithm that consistently estimates any identifiable mixture model from grouped observations. Our analysis leverages an oracle inequality for weighted kernel density estimators of the distribution on groups, together with a general result showing that consistent estimation of the distribution on groups implies consistent estimation of mixture components. A practical implementation is provided for paired observations, and the approach is shown to outperform existing methods, especially when mixture components overlap significantly.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 35fbf0c0-d726-4861-9459-bd779e77ca67Cited by top-tier papers5
- Identifiability of deep generative models without auxiliary informationBohdan Kivva, Goutham Rajendran, Pradeep Ravikumar, Bryon AragamNeurIPS 2022 · 87 citations
- Learning latent causal graphs via mixture oraclesBohdan Kivva, Goutham Rajendran, Pradeep Ravikumar, Bryon AragamNeurIPS 2021 · 66 citations
- Beyond Smoothness: Incorporating Low-Rank Analysis into Nonparametric Density EstimationRobert A. Vandermeulen, Antoine LedentNeurIPS 2021 · 12 citations
- Identifying Latent State-Transition Processes for Individualized Reinforcement LearningYuewen Sun, Biwei Huang, Yu Yao, Donghuo Zeng et al.NeurIPS 2024 · 2 citations
- Identification of Latent Confounders via Investigating the Tensor Ranks of the Nonlinear ObservationsZhengming Chen, Yewei Xia, Feng Xie, Jie Qiao et al.ICML 2025
Related papers
- Mixture Proportion Estimation Beyond IrreducibilityYilun Zhu, Aaron Fjeldsted, Darren Holland, George Landon et al.ICML 2023 · 12 citations
- A Federated Generalized Expectation-Maximization Algorithm for Mixture Models with an Unknown Number of ComponentsMichael Ibrahim, Nagi Gebraeel, Weijun XieICLR 2026 · 1 citation
- Clustering mixtures with almost optimal separation in polynomial timeAllen Liu, Jerry LiSTOC 2022 · 1 citation
- Solving General Elliptical Mixture Models through an Approximate Wasserstein ManifoldShengxi Li, Zeyang Yu, Min Xiang, Danilo P. MandicAAAI 2020 · 6 citations
- Concentric mixtures of Mallows models for top-k rankings: sampling and identifiabilityFabien Collas, Ekhine IrurozkiICML 2021 · 16 citations
