Measuring dissimilarity with diffeomorphism invariance
Théophile Cantelobre, Carlo Ciliberto, Benjamin Guedj, Alessandro Rudi
Abstract
Measures of similarity (or dissimilarity) are a key ingredient to many machine learning algorithms. We introduce DID, a pairwise dissimilarity measure applicable to a wide range of data spaces, which leverages the data's internal structure to be invariant to diffeomorphisms. We prove that DID enjoys properties which make it relevant for theoretical study and practical use. By representing each datum as a function, DID is defined as the solution to an optimization problem in a Reproducing Kernel Hilbert Space and can be expressed in closed-form. In practice, it can be efficiently approximated via Nyström sampling. Empirical experiments support the merits of DID.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on3
- On the Sample Complexity of Learning under Geometric StabilityAlberto Bietti, Luca Venturi, Joan BrunaNeurIPS 2021 · 45 citations
- PSD Representations for Effective Probability ModelsAlessandro Rudi, Carlo CilibertoNeurIPS 2021 · 28 citations
- Relative stability toward diffeomorphisms indicates performance in deep netsLeonardo Petrini, Alessandro Favero, Mario Geiger, Matthieu WyartNeurIPS 2021 · 16 citations
Related papers
- Hilbert Sinkhorn Divergence for Optimal TransportQian Li, Zhichao Wang, Gang Li, Jun Pang et al.CVPR 2021
- Bridging the Gap Between Hyperdimensional Computing and Kernel Methods via the Nyström MethodQuanling Zhao, Anthony Hitchcock Thomas, Ari Brin, Xiaofan Yu et al.AAAI 2025 · 2 citations
- Kernel similarity matching with Hebbian networksKyle Luther, H. Sebastian SeungNeurIPS 2022 · 3 citations
- Estimating Riemannian Metric with Noise-Contaminated Intrinsic DistanceJiaming Qiu, Xiongtao DaiNeurIPS 2023 · 2 citations
- Kernelized Wasserstein Natural GradientMichael Arbel, Arthur Gretton, Wuchen Li, Guido MontúfarICLR 2020 · 23 citations
