Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning Through Object Exchange
Yanhao Wu, Tong Zhang, Wei Ke, Congpei Qiu, Sabine Süsstrunk, Mathieu Salzmann
Abstract
In the realm of point cloud scene understanding, particularly in indoor scenes, objects are arranged following human habits, resulting in objects of certain semantics being closely positioned and displaying notable inter-object cor-relations. This can create a tendency for neural networks to exploit these strong dependencies, bypassing the individ-ual object patterns. To address this challenge, we introduce a novel self-supervised learning (SSL) strategy. Our approach leverages both object patterns and contextual cues to produce robust features. It begins with the formulation of an object-exchanging strategy, where pairs of objects with comparable sizes are exchanged across different scenes, effectively disentangling the strong contextual dependencies. Subsequently, we introduce a context-aware feature learning strategy, which encodes object patterns without relying on their specific context by aggregating object features across various scenes. Our extensive experiments demonstrate the superiority of our method over existing SSL techniques, further showing its better robustness to environmental changes. Moreover, we showcase the applicability of our approach by transferring pre-trained models to diverse point cloud datasets.<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup><sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>Our code is available at https:/lgithub.com/YanhaoWu/OESSL
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f58f12ca-a7c7-4b6c-82f9-86c56e64ff59Cited by top-tier papers4
- PointCSP: Cross-Sample Semantic Propagation and Stability Preservation in Self-Supervised Point Cloud LearningXinxing Yu, Ajian Liu, Sunyuan Qiang, Hui Ma et al.CVPR 2026 · 1 citation
- Masked Scene Modeling: Narrowing the Gap Between Supervised and Self-Supervised Learning in 3D Scene UnderstandingPedro Hermosilla, Christian Stippel, Leon SickCVPR 2025
- Refining CLIP's Spatial Awareness: A Visual-Centric PerspectiveCongpei Qiu, Yanhao Wu, Wei Ke, Xiuxiu Bai et al.ICLR 2025
- Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language ModelZhaochong An, Guolei Sun, Yun Liu, Runjia Li et al.CVPR 2025
Builds on13
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Random Erasing Data AugmentationZhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li et al.AAAI 2020 · 4,134 citations
- In-Place Scene Labelling and Understanding with Implicit Scene RepresentationShuaifeng Zhi, Tristan Laidlow, Stefan Leutenegger, Andrew J. DavisonICCV 2021 · 551 citations
- Self-Supervised Pretraining of 3D Features on any Point-CloudZaiwei Zhang, Rohit Girdhar, Armand Joulin, Ishan MisraICCV 2021 · 333 citations
- Spatio-temporal Self-Supervised Representation Learning for 3D Point CloudsSiyuan Huang, Yichen Xie, Song-Chun Zhu, Yixin ZhuICCV 2021 · 259 citations
Related papers
- PSA-SSL: Pose and Size-aware Self-Supervised Learning on LiDAR Point CloudsBarza Nisar, Steven L. WaslanderCVPR 2025
- Spatiotemporal Self-Supervised Learning for Point Clouds in the WildYanhao Wu, Tong Zhang, Wei Ke, Sabine Süsstrunk et al.CVPR 2023
- Point Contrastive Prediction with Semantic Clustering for Self-Supervised Learning on Point Cloud VideosXiaoxiao Sheng, Zhiqiang Shen, Gang Xiao, Longguang Wang et al.ICCV 2023 · 20 citations
- Construct to Associate: Cooperative Context Learning for Domain Adaptive Point Cloud SegmentationGuangrui LiCVPR 2024
- Shape Self-Correction for Unsupervised Point Cloud UnderstandingYe Chen, Jinxian Liu, Bingbing Ni, Hang Wang et al.ICCV 2021 · 58 citations
