Unsupervised Disentanglement Without Compromises : How Functional Orthogonality Enforces Identifiability
Mathieu Simon, Pascal Frossard, Christophe De Vleeschouwer
摘要
This paper explores unsupervised disentangled representation learning from a functional perspective. We define latent concepts as factors that influence observations through locally orthogonal directions, formalized as an orthogonality constraint on the Jacobian of the generative mapping. We prove that this condition yields identifiability of general nonlinear generative models, without requiring statistical independence or causal assumptions, provided the latent domain admits all combinations of factor values. Experiments with orthogonality-regularized normalizing flows empirically confirm the theory, demonstrate reliable recovery of ground-truth factors, and shed light on the success of VAEs. These findings challenge the prevailing impossibility claims for unsupervised disentanglement and provide a principled alternative foundation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- Weakly-Supervised Disentanglement Without CompromisesFrancesco Locatello, Ben Poole, Gunnar Rätsch, Bernhard Schölkopf 等ICML 2020 · 被引用 361 次
- Weakly supervised causal representation learningJohann Brehmer, Pim de Haan, Phillip Lippe, Taco S. CohenNeurIPS 2022 · 被引用 196 次
- CITRIS: Causal Identifiability from Temporal Intervened SequencesPhillip Lippe, Sara Magliacane, Sindy Löwe, Yuki M. Asano 等ICML 2022 · 被引用 136 次
- Independent mechanism analysis, a new concept?Luigi Gresele, Julius von Kügelgen, Vincent Stimper, Bernhard Schölkopf 等NeurIPS 2021 · 被引用 133 次
- Nonparametric Identifiability of Causal Representations from Unknown InterventionsJulius von Kügelgen, Michel Besserve, Wendong Liang, Luigi Gresele 等NeurIPS 2023 · 被引用 127 次
相关 Paper
- Function Classes for Identifiable Nonlinear Independent Component AnalysisSimon Buchholz, Michel Besserve, Bernhard SchölkopfNeurIPS 2022 · 被引用 63 次
- Mechanistic Independence: A Principle for Identifiable Disentangled RepresentationsStefan Matthes, Zhiwei Han, Hao ShenICLR 2026 · 被引用 3 次
- Causal Component AnalysisWendong Liang, Armin Kekic, Julius von Kügelgen, Simon Buchholz 等NeurIPS 2023 · 被引用 65 次
- Why do Variational Autoencoders Really Promote Disentanglement?Pratik Bhowal, Achint Soni, Sirisha RambhatlaICML 2024 · 被引用 11 次
- Embrace the Gap: VAEs Perform Independent Mechanism AnalysisPatrik Reizinger, Luigi Gresele, Jack Brady, Julius von Kügelgen 等NeurIPS 2022 · 被引用 34 次
