Infinite ShapeOdds: Nonparametric Bayesian Models for Shape Representations
Wei W. Xing, Shireen Y. Elhabian, Robert Michael Kirby, Ross T. Whitaker, Shandian Zhe
Abstract
Learning compact representations for shapes (binary images) is important for many applications. Although neural network models are very powerful, they usually involve many parameters, require substantial tuning efforts and easily overfit small datasets, which are common in shape-related applications. The state-of-the-art approach, ShapeOdds, as a latent Gaussian model, can effectively prevent overfitting and is more robust. Nonetheless, it relies on a linear projection assumption and is incapable of capturing intrinsic nonlinear shape variations, hence may leading to inferior representations and structure discovery. To address these issues, we propose Infinite ShapeOdds (InfShapeOdds), a Bayesian nonparametric shape model, which is flexible enough to capture complex shape variations and discover hidden cluster structures, while still avoiding overfitting. Specifically, we use matrix Gaussian priors, nonlinear feature mappings and the kernel trick to generalize ShapeOdds to a shape-variate Gaussian process model, which can grasp various nonlinear correlations among the pixels within and across (different) shapes. To further discover the hidden structures in data, we place a Dirichlet process mixture (DPM) prior over the representations to jointly infer the cluster number and memberships. Finally, we exploit the Kronecker-product structure in our model to develop an efficient, truncated variational expectation-maximization algorithm for model estimation. On synthetic and real-world data, we show the advantage of our method in both representation learning and latent structure discovery.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Related papers
- PointGMM: A Neural GMM Network for Point CloudsAmir Hertz, Rana Hanocka, Raja Giryes, Daniel Cohen-OrCVPR 2020
- Scalable Gaussian Processes with Latent Kronecker StructureJihao Andreas Lin, Sebastian Ament, Maximilian Balandat, David Eriksson et al.ICML 2025
- A theory of representation learning gives a deep generalisation of kernel methodsAdam X. Yang, Maxime Robeyns, Edward Milsom, Ben Anson et al.ICML 2023 · 15 citations
- Nonparametric Decomposition of Sparse TensorsConor Tillinghast, Shandian ZheICML 2021 · 10 citations
- Bayesian Regularization of Latent RepresentationChukwudi Paul Obite, Zhi Chang, Keyan Wu, Shiwei LanICLR 2025
