Topological Parallax: A Geometric Specification for Deep Perception Models
Abraham D. Smith, Michael J. Catanzaro, Gabrielle Angeloro, Nirav Patel, Paul Bendich
摘要
For safety and robustness of AI systems, we introduce topological parallax as a theoretical and computational tool that compares a trained model to a reference dataset to determine whether they have similar multiscale geometric structure. Our proofs and examples show that this geometric similarity between dataset and model is essential to trustworthy interpolation and perturbation, and we conjecture that this new concept will add value to the current debate regarding the unclear relationship between "overfitting" and "generalization" in applications of deeplearning. In typical DNN applications, an explicit geometric description of the model is impossible, but parallax can estimate topological features (components, cycles, voids, etc.) in the model by examining the effect on the Rips complex of geodesic distortions using the reference dataset. Thus, parallax indicates whether the model shares similar multiscale geometric features with the dataset. Parallax presents theoretically via topological data analysis [TDA] as a bi-filtered persistence module, and the key properties of this module are stable under perturbation of the reference dataset. Preprint. Under review.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper3
- Optimizing persistent homology based functionsMathieu Carrière, Frédéric Chazal, Marc Glisse, Yuichi Ike 等ICML 2021 · 被引用 73 次
- Manifold Topology Divergence: a Framework for Comparing Data ManifoldsSerguei Barannikov, Ilya Trofimov, Grigorii Sotnikov, Ekaterina Trimbach 等NeurIPS 2021 · 被引用 45 次
- Distribution-Aware Testing of Neural Networks Using Generative ModelsSwaroopa Dola, Matthew B. Dwyer, Mary Lou SoffaICSE 2021 · 被引用 3 次
相关 Paper
- Intrinsic Dimension, Persistent Homology and Generalization in Neural NetworksTolga Birdal, Aaron Lou, Leonidas J. Guibas, Umut SimsekliNeurIPS 2021 · 被引用 94 次
- Topological Generalization Bounds for Discrete-Time Stochastic Optimization AlgorithmsRayna Andreeva, Benjamin Dupuis, Rik Sarkar, Tolga Birdal 等NeurIPS 2024 · 被引用 13 次
- On the Limitations of Fractal Dimension as a Measure of GeneralizationCharlie Tan, Inés García-Redondo, Qiquan Wang, Michael M. Bronstein 等NeurIPS 2024 · 被引用 5 次
- Experimental Observations of the Topology of Convolutional Neural Network ActivationsEmilie Purvine, Davis Brown, Brett A. Jefferson, Cliff A. Joslyn 等AAAI 2023 · 被引用 21 次
- PLLay: Efficient Topological Layer based on Persistent LandscapesKwangho Kim, Jisu Kim, Manzil Zaheer, Joon Sik Kim 等NeurIPS 2020 · 被引用 34 次
