Disentangled representation learning through unsupervised symmetry group discovery
Barthélémy Dang-Nhu, Louis Annabi, Sylvain Argentieri
Abstract
Symmetry-based disentangled representation learning leverages the group structure of environment transformations to uncover the latent factors of variation. Prior approaches to symmetry-based disentanglement have required strong prior knowledge of the symmetry group's structure, or restrictive assumptions about the subgroup properties. In this work, we remove these constraints by proposing a method whereby an embodied agent autonomously discovers the group structure of its action space through unsupervised interaction with the environment. We prove the identifiability of the true symmetry group decomposition under minimal assumptions, and derive two algorithms: one for discovering the group decomposition from interaction data, and another for learning Linear Symmetry-Based Disentangled (LSBD) representations without assuming specific subgroup properties. Our method is validated on three environments exhibiting different group decompositions, where it outperforms existing LSBD approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on17
- Object-Centric Learning with Slot AttentionFrancesco Locatello, Dirk Weissenborn, Thomas Unterthiner, Aravindh Mahendran et al.NeurIPS 2020 · 1,275 citations
- A Meta-Transfer Objective for Learning to Disentangle Causal MechanismsYoshua Bengio, Tristan Deleu, Nasim Rahaman, Nan Rosemary Ke et al.ICLR 2020 · 371 citations
- Conditional Object-Centric Learning from VideoThomas Kipf, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Austin Stone et al.ICLR 2022 · 290 citations
- Weakly supervised causal representation learningJohann Brehmer, Pim de Haan, Phillip Lippe, Taco S. CohenNeurIPS 2022 · 196 citations
- CITRIS: Causal Identifiability from Temporal Intervened SequencesPhillip Lippe, Sara Magliacane, Sindy Löwe, Yuki M. Asano et al.ICML 2022 · 136 citations
Related papers
- Learning Disentangled Representations and Group Structure of Dynamical EnvironmentsRobin Quessard, Thomas D. Barrett, William R. ClementsNeurIPS 2020 · 53 citations
- Commutative Lie Group VAE for Disentanglement LearningXinqi Zhu, Chang Xu, Dacheng TaoICML 2021 · 35 citations
- Quantifying and Learning Linear Symmetry-Based DisentanglementLoek Tonnaer, Luis Armando Pérez Rey, Vlado Menkovski, Mike Holenderski et al.ICML 2022 · 17 citations
- Linear Disentangled Representations and Unsupervised Action EstimationMatthew Painter, Adam Prügel-Bennett, Jonathon S. HareNeurIPS 2020 · 24 citations
- Towards Building A Group-based Unsupervised Representation Disentanglement FrameworkTao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng et al.ICLR 2022 · 36 citations
