Geometric Analysis of Nonlinear Manifold Clustering
Nimita Shinde, Tianjiao Ding, Daniel P. Robinson, René Vidal
Abstract
Manifold clustering is an important problem in motion and video segmentation, natural image clustering, and other applications where high-dimensional data lie on multiple, low-dimensional, nonlinear manifolds. While current state-of-the-art methods on large-scale datasets such as CIFAR provide good empirical performance, they do not have any proof of theoretical correctness. In this work, we propose a method that clusters data belonging to a union of nonlinear manifolds. Furthermore, for a given input data sample y belonging to the l th manifold M l , we provide geometric conditions that guarantee a manifold-preserving representation of y can be recovered from the solution to the proposed model. The geometric conditions require that (i) M l is well-sampled in the neighborhood of y , with the sampling density given as a function of the curvature, and (ii) M l is sufficiently separated from the other manifolds. In addition to providing proof of correctness in this setting, a numerical comparison with state-of-the-art methods on CIFAR datasets shows that our method performs competitively although marginally worse than methods without theoretical guarantees.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Reciprocal Multi-Layer Subspace Learning for Multi-View ClusteringRuihuang Li, Changqing Zhang, Huazhu Fu, Xi Peng et al.ICCV 2019 · 138 citations
- A Critique of Self-Expressive Deep Subspace ClusteringBenjamin David Haeffele, Chong You, René VidalICLR 2021 · 35 citations
- Is an Affine Constraint Needed for Affine Subspace Clustering?Chong You, Chun-Guang Li, Daniel P. Robinson, René VidalICCV 2019 · 29 citations
Related papers
- Unsupervised Manifold Linearizing and ClusteringTianjiao Ding, Shengbang Tong, Kwan Ho Ryan Chan, Xili Dai et al.ICCV 2023 · 19 citations
- Verifying the Union of Manifolds Hypothesis for Image DataBradley C. A. Brown, Anthony L. Caterini, Brendan Leigh Ross, Jesse C. Cresswell et al.ICLR 2023 · 6 citations
- Multi-Subspace Multi-Modal Modeling for Diffusion Models: Estimation, Convergence and Mixture of ExpertsRuofeng Yang, Yongcan Li, Bo Jiang, Cheng Chen et al.ICLR 2026 · 4 citations
- Scalable Second-order Riemannian Optimization for -means ClusteringPeng Xu, Chun Ying Hou, Xiaohui Chen, Richard Y. ZhangICLR 2026 · 2 citations
- Multiple Kernel Clustering with Shifted Laplacian on Grassmann ManifoldXi Wu, Chuang Huang, Xinliu Liu, Fei Zhou et al.ACM MM 2024 · 4 citations
