Unsupervised Disentanglement Without Compromises : How Functional Orthogonality Enforces Identifiability
Mathieu Simon, Pascal Frossard, Christophe De Vleeschouwer
Abstract
This paper explores unsupervised disentangled representation learning from a functional perspective. We define latent concepts as factors that influence observations through locally orthogonal directions, formalized as an orthogonality constraint on the Jacobian of the generative mapping. We prove that this condition yields identifiability of general nonlinear generative models, without requiring statistical independence or causal assumptions, provided the latent domain admits all combinations of factor values. Experiments with orthogonality-regularized normalizing flows empirically confirm the theory, demonstrate reliable recovery of ground-truth factors, and shed light on the success of VAEs. These findings challenge the prevailing impossibility claims for unsupervised disentanglement and provide a principled alternative foundation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bf4647a9-67e1-4dc2-aa71-a37896094e36Builds on18
- Weakly-Supervised Disentanglement Without CompromisesFrancesco Locatello, Ben Poole, Gunnar Rätsch, Bernhard Schölkopf et al.ICML 2020 · 361 citations
- Weakly supervised causal representation learningJohann Brehmer, Pim de Haan, Phillip Lippe, Taco S. CohenNeurIPS 2022 · 196 citations
- CITRIS: Causal Identifiability from Temporal Intervened SequencesPhillip Lippe, Sara Magliacane, Sindy Löwe, Yuki M. Asano et al.ICML 2022 · 136 citations
- Independent mechanism analysis, a new concept?Luigi Gresele, Julius von Kügelgen, Vincent Stimper, Bernhard Schölkopf et al.NeurIPS 2021 · 133 citations
- Nonparametric Identifiability of Causal Representations from Unknown InterventionsJulius von Kügelgen, Michel Besserve, Wendong Liang, Luigi Gresele et al.NeurIPS 2023 · 127 citations
Related papers
- Function Classes for Identifiable Nonlinear Independent Component AnalysisSimon Buchholz, Michel Besserve, Bernhard SchölkopfNeurIPS 2022 · 63 citations
- Mechanistic Independence: A Principle for Identifiable Disentangled RepresentationsStefan Matthes, Zhiwei Han, Hao ShenICLR 2026 · 3 citations
- Causal Component AnalysisWendong Liang, Armin Kekic, Julius von Kügelgen, Simon Buchholz et al.NeurIPS 2023 · 65 citations
- Why do Variational Autoencoders Really Promote Disentanglement?Pratik Bhowal, Achint Soni, Sirisha RambhatlaICML 2024 · 11 citations
- Embrace the Gap: VAEs Perform Independent Mechanism AnalysisPatrik Reizinger, Luigi Gresele, Jack Brady, Julius von Kügelgen et al.NeurIPS 2022 · 34 citations
