Topological Parallax: A Geometric Specification for Deep Perception Models
Abraham D. Smith, Michael J. Catanzaro, Gabrielle Angeloro, Nirav Patel, Paul Bendich
Abstract
For safety and robustness of AI systems, we introduce topological parallax as a theoretical and computational tool that compares a trained model to a reference dataset to determine whether they have similar multiscale geometric structure. Our proofs and examples show that this geometric similarity between dataset and model is essential to trustworthy interpolation and perturbation, and we conjecture that this new concept will add value to the current debate regarding the unclear relationship between "overfitting" and "generalization" in applications of deeplearning. In typical DNN applications, an explicit geometric description of the model is impossible, but parallax can estimate topological features (components, cycles, voids, etc.) in the model by examining the effect on the Rips complex of geodesic distortions using the reference dataset. Thus, parallax indicates whether the model shares similar multiscale geometric features with the dataset. Parallax presents theoretically via topological data analysis [TDA] as a bi-filtered persistence module, and the key properties of this module are stable under perturbation of the reference dataset. Preprint. Under review.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on3
- Optimizing persistent homology based functionsMathieu Carrière, Frédéric Chazal, Marc Glisse, Yuichi Ike et al.ICML 2021 · 73 citations
- Manifold Topology Divergence: a Framework for Comparing Data ManifoldsSerguei Barannikov, Ilya Trofimov, Grigorii Sotnikov, Ekaterina Trimbach et al.NeurIPS 2021 · 45 citations
- Distribution-Aware Testing of Neural Networks Using Generative ModelsSwaroopa Dola, Matthew B. Dwyer, Mary Lou SoffaICSE 2021 · 3 citations
Related papers
- Intrinsic Dimension, Persistent Homology and Generalization in Neural NetworksTolga Birdal, Aaron Lou, Leonidas J. Guibas, Umut SimsekliNeurIPS 2021 · 94 citations
- Topological Generalization Bounds for Discrete-Time Stochastic Optimization AlgorithmsRayna Andreeva, Benjamin Dupuis, Rik Sarkar, Tolga Birdal et al.NeurIPS 2024 · 13 citations
- On the Limitations of Fractal Dimension as a Measure of GeneralizationCharlie Tan, Inés García-Redondo, Qiquan Wang, Michael M. Bronstein et al.NeurIPS 2024 · 5 citations
- Experimental Observations of the Topology of Convolutional Neural Network ActivationsEmilie Purvine, Davis Brown, Brett A. Jefferson, Cliff A. Joslyn et al.AAAI 2023 · 21 citations
- PLLay: Efficient Topological Layer based on Persistent LandscapesKwangho Kim, Jisu Kim, Manzil Zaheer, Joon Sik Kim et al.NeurIPS 2020 · 34 citations
