PUFM: Efficient Point Cloud Upsampling via Flow Matching
Zhi-Song Liu, Chenhang He, Yakun Ju, Lei Li
摘要
Diffusion models have recently been adopted for point cloud upsampling due to their effectiveness in solving ill-posed problems. However, existing upsampling methods often struggle with inefficiencies, as they generate dense point clouds by mapping Gaussian noise to data, overlooking the geometric information already present in sparse inputs. To address this, we propose PUFM, a novel Point Cloud Upsampling via Flow Matching, which learns to directly transform sparse point clouds into their high-fidelity dense counterparts. Our approach first applies midpoint interpolation to densify the sparse input. Then, we construct a continuous interpolant between sparse and dense point clouds and train a neural network to estimate the velocity field for flow matching. Given the unordered nature of point clouds, we introduce a pre-alignment step based on Earth Mover's Distance (EMD) optimization to ensure coherent and meaningful interpolation between sparse and dense representations. This results in a more stable and efficient learning trajectory during flow matching. Experiments on synthetic benchmarks demonstrate that our method delivers superior upsampling quality but with fewer sampling steps. Further experiments on ScanNet and KITTI also show that our approach generalizes well to real-world RGB-D and LiDAR point clouds, making it more practical for real-world applications.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 被引用 5,234 次
- PointNeXt: Revisiting PointNet++ with Improved Training and Scaling StrategiesGuocheng Qian, Yuchen Li, Houwen Peng, Jinjie Mai 等NeurIPS 2022 · 被引用 1,270 次
- Point Transformer V2: Grouped Vector Attention and Partition-based PoolingXiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu 等NeurIPS 2022 · 被引用 924 次
- Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP FrameworkXu Ma, Can Qin, Haoxuan You, Haoxi Ran 等ICLR 2022 · 被引用 841 次
相关 Paper
- A Conditional Denoising Diffusion Probabilistic Model for Point Cloud UpsamplingWentao Qu, Yuantian Shao, Lingwu Meng, Xiaoshui Huang 等CVPR 2024 · 被引用 23 次
- PC2-PU: Patch Correlation and Point Correlation for Effective Point Cloud UpsamplingChen Long, Wenxiao Zhang, Ruihui Li, Hao Wang 等ACM MM 2022 · 被引用 32 次
- Learning Continuous Implicit Field with Local Distance Indicator for Arbitrary-Scale Point Cloud UpsamplingShujuan Li, Junsheng Zhou, Baorui Ma, Yu-Shen Liu 等AAAI 2024 · 被引用 37 次
- SPU-IMR: Self-supervised Arbitrary-scale Point Cloud Upsampling via Iterative Mask-recovery NetworkZiming Nie, Qiao Wu, Chenlei Lv, Siwen Quan 等AAAI 2025 · 被引用 2 次
- SPU-PMD: Self-Supervised Point Cloud Upsampling via Progressive Mesh DeformationYanzhe Liu, Rong Chen, Yushi Li, Yixi Li 等CVPR 2024
