PUFM: Efficient Point Cloud Upsampling via Flow Matching
Zhi-Song Liu, Chenhang He, Yakun Ju, Lei Li
Abstract
Diffusion models have recently been adopted for point cloud upsampling due to their effectiveness in solving ill-posed problems. However, existing upsampling methods often struggle with inefficiencies, as they generate dense point clouds by mapping Gaussian noise to data, overlooking the geometric information already present in sparse inputs. To address this, we propose PUFM, a novel Point Cloud Upsampling via Flow Matching, which learns to directly transform sparse point clouds into their high-fidelity dense counterparts. Our approach first applies midpoint interpolation to densify the sparse input. Then, we construct a continuous interpolant between sparse and dense point clouds and train a neural network to estimate the velocity field for flow matching. Given the unordered nature of point clouds, we introduce a pre-alignment step based on Earth Mover's Distance (EMD) optimization to ensure coherent and meaningful interpolation between sparse and dense representations. This results in a more stable and efficient learning trajectory during flow matching. Experiments on synthetic benchmarks demonstrate that our method delivers superior upsampling quality but with fewer sampling steps. Further experiments on ScanNet and KITTI also show that our approach generalizes well to real-world RGB-D and LiDAR point clouds, making it more practical for real-world applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 12ad5859-0399-4967-aa0d-936a5ce93a7fBuilds on20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- PointNeXt: Revisiting PointNet++ with Improved Training and Scaling StrategiesGuocheng Qian, Yuchen Li, Houwen Peng, Jinjie Mai et al.NeurIPS 2022 · 1,270 citations
- Point Transformer V2: Grouped Vector Attention and Partition-based PoolingXiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu et al.NeurIPS 2022 · 924 citations
- Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP FrameworkXu Ma, Can Qin, Haoxuan You, Haoxi Ran et al.ICLR 2022 · 841 citations
Related papers
- A Conditional Denoising Diffusion Probabilistic Model for Point Cloud UpsamplingWentao Qu, Yuantian Shao, Lingwu Meng, Xiaoshui Huang et al.CVPR 2024 · 23 citations
- PC2-PU: Patch Correlation and Point Correlation for Effective Point Cloud UpsamplingChen Long, Wenxiao Zhang, Ruihui Li, Hao Wang et al.ACM MM 2022 · 32 citations
- Learning Continuous Implicit Field with Local Distance Indicator for Arbitrary-Scale Point Cloud UpsamplingShujuan Li, Junsheng Zhou, Baorui Ma, Yu-Shen Liu et al.AAAI 2024 · 37 citations
- SPU-IMR: Self-supervised Arbitrary-scale Point Cloud Upsampling via Iterative Mask-recovery NetworkZiming Nie, Qiao Wu, Chenlei Lv, Siwen Quan et al.AAAI 2025 · 2 citations
- SPU-PMD: Self-Supervised Point Cloud Upsampling via Progressive Mesh DeformationYanzhe Liu, Rong Chen, Yushi Li, Yixi Li et al.CVPR 2024
