GAPrompt: Geometry-Aware Point Cloud Prompt for 3D Vision Model
Zixiang Ai, Zichen Liu, Yuanhang Lei, Zhenyu Cui, Xu Zou, Jiahuan Zhou
Abstract
Pre-trained 3D vision models have gained significant attention for their promising performance on point cloud data. However, fully fine-tuning these models for downstream tasks is computationally expensive and storage-intensive. Existing parameter-efficient fine-tuning (PEFT) approaches, which focus primarily on input token prompting, struggle to achieve competitive performance due to their limited ability to capture the geometric information inherent in point clouds. To address this challenge, we propose a novel Geometry-Aware Point Cloud Prompt (GAPrompt) that leverages geometric cues to enhance the adaptability of 3D vision models. First, we introduce a Point Prompt that serves as an auxiliary input alongside the original point cloud, explicitly guiding the model to capture fine-grained geometric details. Additionally, we present a Point Shift Prompter designed to extract global shape information from the point cloud, enabling instance-specific geometric adjustments at the input level. Moreover, our proposed Prompt Propagation mechanism incorporates the shape information into the model's feature extraction process, further strengthening its ability to capture essential geometric characteristics. Extensive experiments demonstrate that GAPrompt significantly outperforms state-ofthe-art PEFT methods and achieves competitive results compared to full fine-tuning on various benchmarks, while utilizing only 2.19% of trainable parameters. Our code is available at https: //github.com/zhoujiahuan1991/ ICML2025-GAPrompt.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5d7a3e2a-5e14-4af3-b0af-06b91f4de97bCited by top-tier papers2
- UPP: Unified Point-Level Prompting for Robust Point Cloud AnalysisZixiang Ai, Zhenyu Cui, Yuxin Peng, Jiahuan ZhouICCV 2025 · 1 citation
- CKDA: Cross-modality Knowledge Disentanglement and Alignment for Visible-Infrared Lifelong Person Re-identificationZhenyu Cui, Jiahuan Zhou, Yuxin PengAAAI 2026
Builds on23
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- AdaptFormer: Adapting Vision Transformers for Scalable Visual RecognitionShoufa Chen, Chongjian Ge, Zhan Tong, Jiangliu Wang et al.NeurIPS 2022 · 1,291 citations
- Towards a Unified View of Parameter-Efficient Transfer LearningJunxian He, Chunting Zhou, Xuezhe Ma, Taylor Berg-Kirkpatrick et al.ICLR 2022 · 1,182 citations
- Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World DataMikaela Angelina Uy, Quang-Hieu Pham, Binh-Son Hua, Duc Thanh Nguyen et al.ICCV 2019 · 1,003 citations
- Compacter: Efficient Low-Rank Hypercomplex Adapter LayersRabeeh Karimi Mahabadi, James Henderson, Sebastian RuderNeurIPS 2021 · 700 citations
Related papers
- Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained ModelsYiwen Tang, Ray Zhang, Zoey Guo, Xianzheng Ma et al.AAAI 2024
- On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene SegmentationLiyao Tang, Zhe Chen, Dacheng TaoNeurIPS 2025 · 5 citations
- Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud ModelsYaohua Zha, Jinpeng Wang, Tao Dai, Bin Chen et al.ICCV 2023 · 84 citations
- TopAdapter: Topology-Aware Prompt Tuning for Efficient Point Cloud UnderstandingChangshuo Wang, Shuting He, Xiang Fang, Weijun Li et al.ICML 2026
- Positional Prompt Tuning for Efficient 3D Representation LearningShaochen Zhang, Zekun Qi, Runpei Dong, Xiuxiu Bai et al.ACM MM 2025 · 2 citations
