Topology-aware Feature Propagation for Unsupervised Non-rigid Point Cloud Correspondence
Haozhe Chen, Rui Li, Zhengbao Wang, Xinhao Zhu, Linjie Li, Tianyu Xiong, Xuan Ouyang, Jiaqi Yang
Abstract
Unsupervised non-rigid point cloud correspondence aims to predict point-to-point correspondences without annotations. Existing methods leverage the spatial-relation-based feature propagation strategy that includes non-physical connections, which are sensitive to non-rigid deformation. To address this issue, we advocate to learn shape topology robust to non-rigid deformation, and propose the topology-aware feature propagation module integrated into a coarse-to-fine propagation and optimization pipeline. To extract point features robust to non-rigid deformation, we estimate keypoints as superpoints and encode superpoint features with topology weights, which learns reasonable topologies under non-rigid deformation. The vector quantization codebook is leveraged to enhance the original superpoint features with stored representative features across the dataset, improving feature robustness against shape variance. Robust point-wise correspondence is yielded after coarse-to-fine feature fusion and efficient test-time optimization. Extensive experiments on multiple benchmarks demonstrate the state-of-the-art performance of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on32
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- Point Transformer V2: Grouped Vector Attention and Partition-based PoolingXiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu et al.NeurIPS 2022 · 924 citations
- CoFiNet: Reliable Coarse-to-fine Correspondences for Robust PointCloud RegistrationHao Yu, Fu Li, Mahdi Saleh, Benjamin Busam et al.NeurIPS 2021 · 313 citations
- Lepard: Learning partial point cloud matching in rigid and deformable scenesYang Li, Tatsuya HaradaCVPR 2022 · 163 citations
- Unsupervised Deep Learning for Structured Shape MatchingJean-Michel Roufosse, Abhishek Sharma, Maks OvsjanikovICCV 2019 · 160 citations
Related papers
- Unsupervised Template-assisted Point Cloud Shape Correspondence NetworkJiacheng Deng, Jiahao Lu, Tianzhu ZhangCVPR 2024
- Geometric Transformer for Fast and Robust Point Cloud RegistrationZheng Qin, Hao Yu, Changjian Wang, Yulan Guo et al.CVPR 2022 · 436 citations
- SPGroup3D: Superpoint Grouping Network for Indoor 3D Object DetectionYun Zhu, Le Hui, Yaqi Shen, Jin XieAAAI 2024 · 24 citations
- CorrNet3D: Unsupervised End-to-End Learning of Dense Correspondence for 3D Point CloudsYiming Zeng, Yue Qian, Zhiyu Zhu, Junhui Hou et al.CVPR 2021
- SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation NetworkMingmei Cheng, Le Hui, Jin Xie, Jian YangAAAI 2021 · 124 citations
