Deformation-based In-Context Learning for Point Cloud Understanding
Chengxing Lin, Jinhong Deng, Yinjie Lei, Wen Li
Abstract
Recent advances in point cloud In-Context Learning (ICL) have demonstrated strong multitask capabilities. Existing approaches typically adopt a Masked Point Modeling (MPM)-based paradigm for point cloud ICL. However, MPM-based methods directly predict the target point cloud from masked tokens without leveraging geometric priors, requiring the model to infer spatial structure and geometric details solely from token-level correlations via transformers. Additionally, these methods suffer from a training-inference objective mismatch, as the model learns to predict the target point cloud using target-side information that is unavailable at inference time. To address these challenges, we propose DeformPIC, a deformation-based framework for point cloud ICL. Unlike existing approaches that rely on masked reconstruction, DeformPIC learns to deform the query point cloud under task-specific guidance from prompts, enabling explicit geometric reasoning and consistent objectives. Extensive experiments demonstrate that DeformPIC consistently outperforms previous state-of-the-art methods, achieving reductions of 1.6, 1.8, and 4.7 points in average Chamfer Distance on reconstruction, denoising, and registration tasks, respectively. Furthermore, we introduce a new out-of-domain benchmark to evaluate generalization across unseen data distributions, where DeformPIC achieves state-of-the-art performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 09736bea-c073-4225-8844-486ce3a56ffeBuilds on21
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- SimMIM: a Simple Framework for Masked Image ModelingZhenda Xie, Zheng Zhang, Yue Cao, Yutong Lin et al.CVPR 2022 · 1,129 citations
- Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World DataMikaela Angelina Uy, Quang-Hieu Pham, Binh-Son Hua, Duc Thanh Nguyen et al.ICCV 2019 · 1,003 citations
- Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point ModelingXumin Yu, Lulu Tang, Yongming Rao, Tiejun Huang et al.CVPR 2022 · 684 citations
Related papers
- Explore In-Context Learning for 3D Point Cloud UnderstandingZhongbin Fang, Xiangtai Li, Xia Li, Joachim M. Buhmann et al.NeurIPS 2023 · 47 citations
- MICAS: Multi-grained In-Context Adaptive Sampling for 3D Point Cloud ProcessingFeifei Shao, Ping Liu, Zhao Wang, Yawei Luo et al.CVPR 2025
- Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud UnderstandingJincen Jiang, Qianyu Zhou, Yuhang Li, Kui Su et al.CVPR 2026
- PQDT: Pseudo-Query Dual Transformer for Robust Point Cloud RestorationHaoqing Wu, Alexa Nawotki, Jochen GarckeCVPR 2026
- RGGT: A Generative-Prior-Guided Transformer for Unified Rigid and Non-Rigid Point Cloud RegistrationChengyu Zheng, Songlin Yang, Jin Huang, Honghua Chen et al.ICML 2026
