Topological Autoencoders
Michael Moor, Max Horn, Bastian Rieck, Karsten M. Borgwardt
Abstract
We propose a novel approach for preserving topological structures of the input space in latent representations of autoencoders. Using persistent homology, a technique from topological data analysis, we calculate topological signatures of both the input and latent space to derive a topological loss term. Under weak theoretical assumptions, we construct this loss in a differentiable manner, such that the encoding learns to retain multi-scale connectivity information. We show that our approach is theoretically well-founded and that it exhibits favourable latent representations on a synthetic manifold as well as on real-world image data sets, while preserving low reconstruction errors.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4fa37b38-677e-47eb-8a7e-54d27c115e90Cited by top-tier papers53
- Generalized Shape Metrics on Neural RepresentationsAlex H. Williams, Erin Kunz, Simon Kornblith, Scott W. LindermanNeurIPS 2021 · 182 citations
- Topological Graph Neural NetworksMax Horn, Edward De Brouwer, Michael Moor, Yves Moreau et al.ICLR 2022 · 135 citations
- Representation Topology Divergence: A Method for Comparing Neural Network RepresentationsSerguei Barannikov, Ilya Trofimov, Nikita Balabin, Evgeny BurnaevICML 2022 · 69 citations
- Manifold Topology Divergence: a Framework for Comparing Data ManifoldsSerguei Barannikov, Ilya Trofimov, Grigorii Sotnikov, Ekaterina Trimbach et al.NeurIPS 2021 · 45 citations
- PLLay: Efficient Topological Layer based on Persistent LandscapesKwangho Kim, Jisu Kim, Manzil Zaheer, Joon Sik Kim et al.NeurIPS 2020 · 34 citations
Related papers
- Learning topology-preserving data representationsIlya Trofimov, Daniil Cherniavskii, Eduard Tulchinskii, Nikita Balabin et al.ICLR 2023 · 2 citations
- Improving Self-supervised Molecular Representation Learning using Persistent HomologyYuankai Luo, Lei Shi, Veronika ThostNeurIPS 2023 · 13 citations
- TopoImages: Incorporating Local Topology Encoding into Deep Learning Models for Medical Image ClassificationPengfei Gu, Hongxiao Wang, Yejia Zhang, Huimin Li et al.ACM MM 2025 · 4 citations
- Learning Probabilistic Topological Representations Using Discrete Morse TheoryXiaoling Hu, Dimitris Samaras, Chao ChenICLR 2023 · 4 citations
- Do Topological Characteristics Help in Knowledge Distillation?Jungeun Kim, Junwon You, Dongjin Lee, Ha Young Kim et al.ICML 2024 · 11 citations
