Permuton-induced Chinese Restaurant Process
Masahiro Nakano, Yasuhiro Fujiwara, Akisato Kimura, Takeshi Yamada, Naonori Ueda
Abstract
This paper proposes the permuton-induced Chinese restaurant process (PCRP), a stochastic process on rectangular partitioning of a matrix. This distribution is suitable for use as a prior distribution in Bayesian nonparametric relational model to find hidden clusters in matrices and network data. Our main contribution is to introduce the notion of permutons into the well-known Chinese restaurant process (CRP) for sequence partitioning: a permuton is a probability measure on [0, 1] × [0, 1] and can be regarded as a geometric interpretation of the scaling limit of permutations. Specifically, we extend the model that the table order of CRPs has a random geometric arrangement on [0, 1] × [0, 1] drawn from the permuton. By analogy with the relationship between the stick-breaking process (SBP) and CRP for the infinite mixture model of a sequence, this model can be regarded as a multidimensional extension of CRP paired with the block-breaking process (BBP), which has been recently proposed as a multi-dimensional extension of SBP. While BBP always has an infinite number of redundant intermediate variables, PCRP can be composed of varying size intermediate variables in a data-driven manner depending on the size and quality of the observation data. Experiments show that PCRP can improve the prediction performance in relational data analysis by reducing the local optima and slow mixing problems compared with the conventional BNP models because the local transitions of PCRP in Markov chain Monte Carlo inference are more flexible than the previous models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Related papers
- Baxter Permutation ProcessMasahiro Nakano, Akisato Kimura, Takeshi Yamada, Naonori UedaNeurIPS 2020 · 7 citations
- Tree-Structured Topic Modeling with Nonparametric Neural Variational InferenceZiye Chen, Cheng Ding, Zusheng Zhang, Yanghui Rao et al.ACL 2021
- Fragmentation Coagulation Based Mixed Membership Stochastic BlockmodelZheng Yu, Xuhui Fan, Marcin Pietrasik, Marek Z. ReformatAAAI 2020 · 6 citations
- Amortized Mixing Coupling Processes for ClusteringHuafeng Liu, Liping JingNeurIPS 2022
- Performance Gaps in Multi-view Clustering under the Nested Matrix-Tensor ModelHugo Lebeau, Mohamed El Amine Seddik, José Henrique de Morais GoulartICLR 2024 · 1 citation
