GAP: Gaussianize Any Point Clouds with Text Guidance
Weiqi Zhang, Junsheng Zhou, Haotian Geng, Wenyuan Zhang, Yu-Shen Liu
摘要
3D Gaussian Splatting (3DGS) has demonstrated its advantages in achieving fast and high-quality rendering. As point clouds serve as a widely-used and easily accessible form of 3D representation, bridging the gap between point clouds and Gaussians becomes increasingly important. Recent studies have explored how to convert the colored points into Gaussians, but directly generating Gaussians from colorless 3D point clouds remains an unsolved challenge. In this paper, we propose GAP, a novel approach that gaussianizes raw point clouds into high-fidelity 3D Gaussians with text guidance. Our key idea is to design a multi-view optimization framework that leverages a depth-aware image diffusion model to synthesize consistent appearances across different viewpoints. To ensure geometric accuracy, we introduce a surface-anchoring mechanism that effectively constrains Gaussians to lie on the surfaces of 3D shapes during optimization. Furthermore, GAP incorporates a diffusebased inpainting strategy that specifically targets at completing hard-to-observe regions. We evaluate GAP on the Point-to-Gaussian generation task across varying complexity levels, from synthetic point clouds to challenging real-world scans, and even large-scale scenes. Project Page: https://weiqi-zhang.github.io/GAP.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material InferenceWenyuan Zhang, Jimin Tang, Weiqi Zhang, Yi Fang 等NeurIPS 2025 · 被引用 25 次
- MoRe: Motion-aware Feed-forward 4D Reconstruction TransformerJuntong Fang, Zequn Chen, Weiqi Zhang, Donglin Di 等CVPR 2026 · 被引用 8 次
- U-CAN: Unsupervised Point Cloud Denoising with Consistency-Aware Noise2Noise MatchingJunsheng Zhou, Xingyu Shi, Haichuan Song, Yi Fang 等NeurIPS 2025 · 被引用 7 次
- SparseRecon: Neural Implicit Surface Reconstruction from Sparse Views with Feature and Depth ConsistenciesLiang Han, Xu Zhang, Haichuan Song, Kanle Shi 等ICCV 2025 · 被引用 5 次
- GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text GuidanceWeiqi Zhang, Junsheng Zhou, Haotian Geng, Kanle Shi 等CVPR 2026 · 被引用 2 次
它引用的顶会 Paper45
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
相关 Paper
- UniGS: Unified Language-Image-3D Pretraining with Gaussian SplattingHaoyuan Li, Yanpeng Zhou, Tao Tang, Jifei Song 等ICLR 2025
- DiffGS: Functional Gaussian Splatting DiffusionJunsheng Zhou, Weiqi Zhang, Yu-Shen LiuNeurIPS 2024 · 被引用 69 次
- Text-to-3D using Gaussian SplattingZilong Chen, Feng Wang, Yikai Wang, Huaping LiuCVPR 2024
- PointGS: Semantic-Consistent Unsupervised 3D Point Cloud Segmentation with 3D Gaussian SplattingYixiao Song, Qingyong Li, Wen Wang, Zhicheng YanCVPR 2026 · 被引用 4 次
- GaussianPainter: Painting Point Cloud into 3D Gaussians with Normal GuidanceJingqiu Zhou, Lue Fan, Xuesong Chen, Linjiang Huang 等AAAI 2025 · 被引用 5 次
