Generated and Pseudo Content guided Prototype Refinement for Few-shot Point Cloud Segmentation
Lili Wei, Congyan Lang, Ziyi Chen, Tao Wang, Yidong Li, Jun Liu
Abstract
Few-shot 3D point cloud semantic segmentation aims to segment query point clouds with only a few annotated support point clouds. Existing prototype-based methods learn prototypes from the 3D support set to guide the segmentation of query point clouds. However, they encounter the challenge of low prototype quality due to constrained semantic information in the 3D support set and class information bias between support and query sets. To address these issues, in this paper, we propose a novel framework called G enerated and P seudo C ontent guided P rototype R efinement (GPCPR), which explicitly leverages LLM-generated content and reliable query context to enhance prototype quality. GPCPR achieves prototype refinement through two core components: LLM-driven Generated Content-guided Prototype Refinement (GCPR) and Pseudo Query Context-guided Prototype Re-finement (PCPR). Specifically, GCPR integrates diverse and differentiated class descriptions generated by large language models to enrich prototypes with comprehensive semantic knowledge. PCPR further aggregates reliable class-specific pseudo-query context to mitigate class information bias and generate more suitable query-specific prototypes. Furthermore, we introduce a dual-distillation regularization term, enabling knowledge transfer between early-stage entities (prototypes or pseudo predictions) and their deeper counterparts to enhance refinement. Extensive experiments demonstrate the superiority of our method, surpassing the state-of-the-art methods by up to 12.10% and 13.75% mIoU on S3DIS and ScanNet, respectively.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- Reasoning Beyond Points: A Visual Introspective Approach for Few-Shot 3D SegmentationChangshuo Wang, Shuting He, Xiang Fang, Zhijian Hu et al.NeurIPS 2025 · 28 citations
- Generalized Few-Shot Point Cloud Segmentation via LLM-Assisted Hyper-Relation MatchingZhaoyang Li, Yuan Wang, Guoxin Xiong, Wangkai Li et al.ICCV 2025 · 5 citations
- From Coarse to Fine: Deep Prototype Refinement Network for Few-Shot Point Cloud Semantic SegmentationChangshuo Wang, Weijun Li, Shuting He, Xiang Fang et al.ICML 2026
- Leveraging Textual Compositional Reasoning for Robust Change CaptioningKyu Ri Park, Jiyoung Park, Seong Tae Kim, Hong Joo Lee et al.AAAI 2026
- DyPolySeg: Taylor Series-Inspired Dynamic Polynomial Fitting Network for Few-shot Point Cloud Semantic SegmentationChangshuo Wang, Xiang Fang, Prayag TiwariICML 2025
Builds on20
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationJunnan Li, Dongxu Li, Caiming Xiong, Steven C. H. HoiICML 2022 · 6,549 citations
- MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsDeyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li et al.ICLR 2024 · 3,079 citations
Related papers
- Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided EnhancementZhenhua Ning, Zhuotao Tian, Guangming Lu, Wenjie PeiACM MM 2023 · 22 citations
- Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language ModelZhaochong An, Guolei Sun, Yun Liu, Runjia Li et al.CVPR 2025
- EPSegFZ: Efficient Point Cloud Semantic Segmentation for Few- and Zero-Shot Scenarios with Language GuidanceJiahui Wang, Haiyue Zhu, Haoren Guo, Abdullah Al Mamun et al.AAAI 2026 · 1 citation
- Generalized Few-Shot Point Cloud Segmentation Via Geometric WordsYating Xu, Conghui Hu, Na Zhao, Gim Hee LeeICCV 2023 · 18 citations
- Few-Shot 3D Point Cloud Semantic SegmentationNa Zhao, Tat-Seng Chua, Gim Hee LeeCVPR 2021
