Introducing Routing Uncertainty in Capsule Networks
Fabio De Sousa Ribeiro, Georgios Leontidis, Stefanos D. Kollias
Abstract
Rather than performing inefficient local iterative routing between adjacent capsule layers, we propose an alternative global view based on representing the inherent uncertainty in part-object assignment. In our formulation, the local routing iterations are replaced with variational inference of part-object connections in a probabilistic capsule network, leading to a significant speedup without sacrificing performance. In this way, global context is also considered when routing capsules by introducing global latent variables that have direct influence on the objective function, and are updated discriminatively in accordance with the minimum description length (MDL) principle. We focus on enhancing capsule network properties, and perform a thorough evaluation on pose-aware tasks, observing improvements in performance over previous approaches whilst being more computationally efficient.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers8
- Lie Group Decompositions for Equivariant Neural NetworksMircea Mironenco, Patrick ForréICLR 2024 · 11 citations
- Enabling Equivariance for Arbitrary Lie GroupsLachlan E. MacDonald, Sameera Ramasinghe, Simon LuceyCVPR 2022 · 11 citations
- Identifiable Object-Centric Representation Learning via Probabilistic Slot AttentionAvinash Kori, Francesco Locatello, Ainkaran Santhirasekaram, Francesca Toni et al.NeurIPS 2024 · 11 citations
- A Receptor Skeleton for Capsule Neural NetworksJintai Chen, Hongyun Yu, Chengde Qian, Danny Z. Chen et al.ICML 2021 · 5 citations
- Flow Stochastic Segmentation NetworksFabio De Sousa Ribeiro, Omar Todd, Charles Jones, Avinash Kori et al.ICCV 2025 · 4 citations
Builds on6
- Capsule Routing via Variational BayesFabio De Sousa Ribeiro, Georgios Leontidis, Stefanos D. KolliasAAAI 2020 · 93 citations
- Capsules with Inverted Dot-Product Attention RoutingYao-Hung Hubert Tsai, Nitish Srivastava, Hanlin Goh, Ruslan SalakhutdinovICLR 2020 · 91 citations
- Detecting and Diagnosing Adversarial Images with Class-Conditional Capsule ReconstructionsYao Qin, Nicholas Frosst, Sara Sabour, Colin Raffel et al.ICLR 2020 · 76 citations
- SubSpace Capsule NetworkMarzieh Edraki, Nazanin Rahnavard, Mubarak ShahAAAI 2020 · 38 citations
- Building Deep Equivariant Capsule NetworksSai Raam Venkataraman, S. Balasubramanian, R. Raghunatha SarmaICLR 2020 · 28 citations
Related papers
- DECA: Deep viewpoint-Equivariant human pose estimation using Capsule AutoencodersNicola Garau, Niccolò Bisagno, Piotr Bródka, Nicola ConciICCV 2021 · 34 citations
- PT-CapsNet: A Novel Prediction-Tuning Capsule Network Suitable for Deeper ArchitecturesChenbin Pan, Senem VelipasalarICCV 2021 · 11 citations
- QuadTreeCapsule: QuadTree Capsules for Deep Regression TrackingDing Ma, Xiangqian WuACM MM 2022 · 2 citations
- Linguistically Routing Capsule Network for Out-of-distribution Visual Question AnsweringQingxing Cao, Wentao Wan, Keze Wang, Xiaodan Liang et al.ICCV 2021 · 16 citations
- CapsuleRRT: Relationships-Aware Regression Tracking via CapsulesDing Ma, Xiangqian WuCVPR 2021
