Diffusion-Based Contextual Reconstruction for Point Cloud Segmentation with Limited Annotations
Jiawei Lian, Zhengxue Wang, Wentao Qu, Haobo Jiang, Le Hui, Jian Yang
Abstract
Point cloud semantic segmentation is fundamental to 3D scene understanding, but dense annotation requirements limit scalability. Although recent label propagation and contrastive learning methods enhance local consistency, the incomplete object coverage caused by sparse annotations hinders global context modeling, ultimately limiting overall performance. To this end, we propose a diffusion-based contextual reconstruction framework for point cloud semantic segmentation with limited annotations. At its core, our framework guides denoising with semantic predictions, using better context reconstruction to enhance the conditional model for better segmentation. Specifically, our contributions include: (1) Diffusion-based segmentation framework: reconstructs contextual semantics from noise under conditional guidance, sharing the decoder with the segmentation module for robust contextual semantic learning. (2) Dynamically aggregates local context from segmentation features and guides denoising with global spatial structure, significantly enhancing denoising quality and contextual awareness. Notably, we pioneer diffusion models for 3D semantic segmentation with limited annotations, enabling efficient single-step inference. Experiments show robustness across varying annotation ratios and state-of-the-art performance on benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 00050082-126d-440c-9784-d4eb21f4a6d3Builds on31
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR SequencesJens Behley, Martin Garbade, Andres Milioto, Jan Quenzel et al.ICCV 2019 · 2,345 citations
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
- Pyramid Point Cloud Transformer for Large-Scale Place RecognitionLe Hui, Hang Yang, Mingmei Cheng, Jin Xie et al.ICCV 2021 · 147 citations
- SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation NetworkMingmei Cheng, Le Hui, Jin Xie, Jian YangAAAI 2021 · 124 citations
Related papers
- Diffusion-SS3D: Diffusion Model for Semi-supervised 3D Object DetectionCheng-Ju Ho, Chen-Hsuan Tai, Yen-Yu Lin, Ming-Hsuan Yang et al.NeurIPS 2023 · 31 citations
- Weakly Supervised 3D Segmentation via Receptive-Driven Pseudo Label Consistency and Structural ConsistencyYuxiang Lan, Yachao Zhang, Yanyun Qu, Cong Wang et al.AAAI 2023 · 14 citations
- Graph-Guided Dual-Level Augmentation for 3D Scene SegmentationHongbin Lin, Yifan Jiang, Juangui Xu, Jesse Jiaxi Xu et al.ACM MM 2025
- Harnessing Text-to-Image Diffusion Models for Point Cloud Self-Supervised LearningYiyang Chen, Shanshan Zhao, Lunhao Duan, Changxing Ding et al.ICCV 2025
- Exploring Dual Representations in Large-Scale Point Clouds: A Simple Weakly Supervised Semantic Segmentation FrameworkJiaming Liu, Yue Wu, Maoguo Gong, Qiguang Miao et al.ACM MM 2023 · 13 citations
