TouchDream: 3D Object Completion through Imagined Touch
Yuanbo Wang, Xinning Wang, Zhaoxuan Zhang, Changlong Wang, qianchen xia, Xiaopeng Wei, Xin Yang
Abstract
Point cloud completion is crucial for robust 3D perception but remains challenging due to its ill-posed nature. Coarse-to-fine methods can lead to unconstrained local guesses in the absence of key structures, whereas diffusion-based approaches may introduce geometric inconsistencies. To overcome these limitations, we present TouchDream, a novel framework that leverages a diffusion model to 'dream' of tactile sensing on object surfaces, which reformulates the sensing process as a learnable generative modeling task. Unlike visual cues, tactile data provides rich local geometry that can be directly converted into 3D space for point fusion, offering a powerful guide for detail-aware completion. Specifically, our approach generate compact tactile latent representations conditioned on coarse points and sampled touch poses. A touch-guided refinement module then leverages touch features to optimize coarse points. Extensive experiments show that our TouchDream model achieves the state-of-the-art performance, significantly enhancing the recovery of local details.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4aa4eb28-ee8b-4979-a8f3-1c91862b3553Builds on20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- 3D Shape Generation and Completion through Point-Voxel DiffusionLinqi Zhou, Yilun Du, Jiajun WuICCV 2021 · 681 citations
- PoinTr: Diverse Point Cloud Completion with Geometry-Aware TransformersXumin Yu, Yongming Rao, Ziyi Wang, Zuyan Liu et al.ICCV 2021 · 592 citations
- Morphing and Sampling Network for Dense Point Cloud CompletionMinghua Liu, Lu Sheng, Sheng Yang, Jing Shao et al.AAAI 2020 · 363 citations
- SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-TransformerPeng Xiang, Xin Wen, Yu-Shen Liu, Yan-Pei Cao et al.ICCV 2021 · 318 citations
Related papers
- Tactile DreamFusion: Exploiting Tactile Sensing for 3D GenerationRuihan Gao, Kangle Deng, Gengshan Yang, Wenzhen Yuan et al.NeurIPS 2024 · 13 citations
- Touch2Shape: Touch-Conditioned 3D Diffusion for Shape Exploration and ReconstructionYuanbo Wang, Zhaoxuan Zhang, Jiajin Qiu, Dilong Sun et al.CVPR 2025
- Diffusion Probabilistic Models for 3D Point Cloud GenerationShitong Luo, Wei HuCVPR 2021
- Digging into Intrinsic Contextual Information for High-fidelity 3D Point Cloud CompletionJisheng Chu, Wenrui Li, Xingtao Wang, Kanglin Ning et al.AAAI 2025 · 1 citation
- GeoComplete: Geometry-Aware Diffusion for Reference-Driven Image CompletionBeibei Lin, Tingting Chen, Robby T. TanNeurIPS 2025 · 10 citations
