Integrating Efficient Optimal Transport and Functional Maps for Unsupervised Shape Correspondence Learning
Tung Le, Khai Nguyen, Shanlin Sun, Nhat Ho, Xiaohui Xie
Abstract
In the realm of computer vision and graphics, accurately establishing correspondences between geometric 3D shapes is pivotal for applications like object tracking, registration, texture transfer, and statistical shape analysis. Moving beyond traditional hand-crafted and data-driven feature learning methods, we incorporate spectral methods with deep learning, focusing on functional maps (FMs) and optimal transport (OT). Traditional OT-based approaches, often reliant on entropy regularization OT in learning-based framework, face computational challenges due to their quadratic cost. Our key contribution is to employ the sliced Wasserstein distance (SWD) for OT, which is a valid fast optimal transport metric in an unsupervised shape matching framework. This unsupervised framework integrates functional map regularizers with a novel OT-based loss derived from SWD, enhancing feature alignment between shapes treated as discrete probability measures. We also introduce an adaptive refinement process utilizing entropy regularized OT, further refining feature alignments for accurate pointto-point correspondences. Our method demonstrates superior performance in non-rigid shape matching, including near-isometric and non-isometric scenarios, and excels in downstream tasks like segmentation transfer. The empirical results on diverse datasets highlight our framework's effectiveness and generalization capabilities, setting new standards in non-rigid shape matching with efficient OT metrics and an adaptive refinement module. Code is available at 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers9
- Sliced Wasserstein with Random-Path Projecting DirectionsKhai Nguyen, Shujian Zhang, Tam Le, Nhat HoICML 2024 · 17 citations
- Diffeomorphic Mesh Deformation via Efficient Optimal Transport for Cortical Surface ReconstructionThanh-Tung Le, Khai Nguyen, Shanlin Sun, Kun Han et al.ICLR 2024 · 9 citations
- Hierarchical Hybrid Sliced Wasserstein: A Scalable Metric for Heterogeneous Joint DistributionsKhai Nguyen, Nhat HoNeurIPS 2024 · 8 citations
- Optimizing Distributional Geometry Alignment with Optimal Transport for Generative Dataset DistillationXiao Cui, Yulei Qin, Wengang Zhou, Hongsheng Li et al.NeurIPS 2025 · 5 citations
- Grasp2Grasp: Vision-Based Dexterous Grasp Translation via Schrödinger BridgesTao Zhong, Jonah Buchanan, Christine Allen-BlanchetteNeurIPS 2025 · 4 citations
Builds on17
- Unsupervised Deep Learning for Structured Shape MatchingJean-Michel Roufosse, Abhishek Sharma, Maks OvsjanikovICCV 2019 · 160 citations
- 4DComplete: Non-Rigid Motion Estimation Beyond the Observable SurfaceYang Li, Hikari Takehara, Takafumi Taketomi, Bo Zheng et al.ICCV 2021 · 160 citations
- Deep Shells: Unsupervised Shape Correspondence with Optimal TransportMarvin Eisenberger, Aysim Toker, Laura Leal-Taixé, Daniel CremersNeurIPS 2020 · 107 citations
- Point-set Distances for Learning Representations of 3D Point CloudsTrung Nguyen, Quang-Hieu Pham, Tam Le, Tung Pham et al.ICCV 2021 · 89 citations
- Accurate Point Cloud Registration with Robust Optimal TransportZhengyang Shen, Jean Feydy, Peirong Liu, Ariel Hernán Curiale et al.NeurIPS 2021 · 81 citations
Related papers
- From Feature Learning to Spectral Basis Learning: A Unifying and Flexible Framework for Efficient and Robust Shape MatchingFeifan Luo, Hongyang ChenCVPR 2026 · 2 citations
- Unsupervised Learning of Robust Spectral Shape MatchingDongliang Cao, Paul Roetzer, Florian BernardSIGGRAPH 2023 · 45 citations
- Non-Rigid Shape Registration via Deep Functional Maps PriorPuhua Jiang, Mingze Sun, Ruqi HuangNeurIPS 2023 · 23 citations
- DiffuMatch: Category-Agnostic Spectral Diffusion Priors for Robust Non-Rigid Shape MatchingEmery Pierson, Lei Li, Angela Dai, Maks OvsjanikovICCV 2025 · 5 citations
- Unsupervised Contrastive Learning for Efficient and Robust Spectral Shape MatchingFeifan Luo, Hongyang ChenAAAI 2026
