TouchDream: 3D Object Completion through Imagined Touch
Yuanbo Wang, Xinning Wang, Zhaoxuan Zhang, Changlong Wang, qianchen xia, Xiaopeng Wei, Xin Yang
摘要
Point cloud completion is crucial for robust 3D perception but remains challenging due to its ill-posed nature. Coarse-to-fine methods can lead to unconstrained local guesses in the absence of key structures, whereas diffusion-based approaches may introduce geometric inconsistencies. To overcome these limitations, we present TouchDream, a novel framework that leverages a diffusion model to 'dream' of tactile sensing on object surfaces, which reformulates the sensing process as a learnable generative modeling task. Unlike visual cues, tactile data provides rich local geometry that can be directly converted into 3D space for point fusion, offering a powerful guide for detail-aware completion. Specifically, our approach generate compact tactile latent representations conditioned on coarse points and sampled touch poses. A touch-guided refinement module then leverages touch features to optimize coarse points. Extensive experiments show that our TouchDream model achieves the state-of-the-art performance, significantly enhancing the recovery of local details.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- 3D Shape Generation and Completion through Point-Voxel DiffusionLinqi Zhou, Yilun Du, Jiajun WuICCV 2021 · 被引用 681 次
- PoinTr: Diverse Point Cloud Completion with Geometry-Aware TransformersXumin Yu, Yongming Rao, Ziyi Wang, Zuyan Liu 等ICCV 2021 · 被引用 592 次
- Morphing and Sampling Network for Dense Point Cloud CompletionMinghua Liu, Lu Sheng, Sheng Yang, Jing Shao 等AAAI 2020 · 被引用 363 次
- SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-TransformerPeng Xiang, Xin Wen, Yu-Shen Liu, Yan-Pei Cao 等ICCV 2021 · 被引用 318 次
相关 Paper
- Tactile DreamFusion: Exploiting Tactile Sensing for 3D GenerationRuihan Gao, Kangle Deng, Gengshan Yang, Wenzhen Yuan 等NeurIPS 2024 · 被引用 13 次
- Touch2Shape: Touch-Conditioned 3D Diffusion for Shape Exploration and ReconstructionYuanbo Wang, Zhaoxuan Zhang, Jiajin Qiu, Dilong Sun 等CVPR 2025
- Diffusion Probabilistic Models for 3D Point Cloud GenerationShitong Luo, Wei HuCVPR 2021
- Digging into Intrinsic Contextual Information for High-fidelity 3D Point Cloud CompletionJisheng Chu, Wenrui Li, Xingtao Wang, Kanglin Ning 等AAAI 2025 · 被引用 1 次
- GeoComplete: Geometry-Aware Diffusion for Reference-Driven Image CompletionBeibei Lin, Tingting Chen, Robby T. TanNeurIPS 2025 · 被引用 10 次
