SGSoft: Learning Fused Semantic-Geometric Features for 3D Shape Correspondence via Template-Guided Soft Signals
Soyeon Yoon, Chang Wook Seo, Hyunjung Shim
Abstract
Learning dense correspondences across deformable 3D shapes remains a long-standing challenge due to structural variability, non-isometric deformation, and inconsistent topology. Existing methods typically trade off generalization, geometric fidelity, and efficiency.We address this by proposing SGSoft, a unified intrinsic pipeline that (i) constructs a geodesic correspondence field on a canonical template, (ii) learns multimodal dense descriptors guided by pretrained semantic priors with this geodesic correspondence field supervision, (iii) retrieves dense correspondences in a single feed-forward pass via nearest-neighbor search in descriptor space.This formulation enables stable and topology-invariant supervision under large pose variation, structural differences, and remeshing.SGSoft achieves state-of-the-art inter-category generalization while offering the best accuracy–efficiency trade-off among prior methods. It also achieves near real-time inference without pre-alignment, pairwise optimization, or post-refinement. Learned descriptors can be transferred effectively to downstream tasks such as semantic segmentation and deformation transfer, establishing a scalable and deployment-ready paradigm for dense 3D correspondence. Code and pretrained models will be released upon acceptance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1f8f7dbb-3f4e-42bb-ad2a-0ece9921b857Builds on38
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann et al.ICLR 2024 · 4,569 citations
- PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human DigitizationShunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima et al.ICCV 2019 · 1,411 citations
- Vision Transformers Need RegistersTimothée Darcet, Maxime Oquab, Julien Mairal, Piotr BojanowskiICLR 2024 · 769 citations
- Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point ModelingXumin Yu, Lulu Tang, Yongming Rao, Tiejun Huang et al.CVPR 2022 · 684 citations
Related papers
- Learning SO(3)-Invariant Semantic Correspondence via Local Shape TransformChunghyun Park, Seungwook Kim, Jaesik Park, Minsu ChoCVPR 2024 · 2 citations
- Semantic-Aware Implicit Template Learning via Part Deformation ConsistencySihyeon Kim, Juyeon Ko, Minseok Joo, Juhan Cha et al.ICCV 2023 · 3 citations
- Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable ObjectsBaowen Zhang, Jiahe Li, Xiaoming Deng, Yinda Zhang et al.ICCV 2023 · 10 citations
- Deep Geometric Functional Maps: Robust Feature Learning for Shape CorrespondenceNicolas Donati, Abhishek Sharma, Maks OvsjanikovCVPR 2020
- NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One GoMarvin Eisenberger, David Novotný, Gael Kerchenbaum, Patrick Labatut et al.CVPR 2021
