Learning Dynamic Point Cloud Compression via Hierarchical Inter-frame Block Matching
Shuting Xia, Tingyu Fan, Yiling Xu, Jenq-Neng Hwang, Zhu Li
Abstract
3D dynamic point cloud (DPC) compression relies on mining its temporal context, which faces significant challenges due to DPC's sparsity and non-uniform structure. Existing methods are limited in capturing sufficient temporal dependencies. Therefore, this paper proposes a learning-based DPC compression framework via hierarchical block-matching-based inter-prediction module to compensate and compress the DPC geometry in latent space. Specifically, we propose a hierarchical motion estimation and motion compensation (Hie-ME/MC) framework for flexible inter-prediction, which dynamically selects the granularity of optical flow to encapsulate the motion information accurately. To improve the motion estimation efficiency of the proposed inter-prediction module, we further design a KNN-attention block matching (KABM) network that determines the impact of potential corresponding points based on the geometry and feature correlation. Finally, we compress the residual and the multi-scale optical flow with a fully-factorized deep entropy model. The experiment result on the MPEG-specified Owlii Dynamic Human Dynamic Point Cloud (Owlii) dataset shows that our framework outperforms the previous state-of-the-art methods and the MPEG standard V-PCC v18 in inter-frame low-delay mode.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a5cf38f5-8040-423f-a8f3-016b8cd17d6bCited by top-tier papers2
- AdaDPCC: Adaptive Rate Control and Rate-Distortion-Complexity Optimization for Dynamic Point Cloud CompressionChenhao Zhang, Wei GaoAAAI 2025 · 8 citations
- AnyPcc: Compressing Any Point Cloud with a Single Universal ModelKangli Wang, Qianxi Yi, Yuqi Ye, Shihao Li et al.CVPR 2026 · 4 citations
Builds on8
- Deep Contextual Video CompressionJiahao Li, Bin Li, Yan LuNeurIPS 2021 · 518 citations
- Hybrid Spatial-Temporal Entropy Modelling for Neural Video CompressionJiahao Li, Bin Li, Yan LuACM MM 2022 · 202 citations
- OctAttention: Octree-Based Large-Scale Contexts Model for Point Cloud CompressionChunyang Fu, Ge Li, Rui Song, Wei Gao et al.AAAI 2022 · 191 citations
- Coarse-To-Fine Deep Video Coding with Hyperprior-Guided Mode PredictionZhihao Hu, Guo Lu, Jinyang Guo, Shan Liu et al.CVPR 2022 · 95 citations
- Neural Video Compression with Diverse ContextsJiahao Li, Bin Li, Yan LuCVPR 2023
Related papers
- VoxelContext-Net: An Octree Based Framework for Point Cloud CompressionZizheng Que, Guo Lu, Dong XuCVPR 2021
- Fast Inter-frame Motion Prediction for Compressed Dynamic Point Cloud Attribute EnhancementWang Liu, Wei Gao, Xingming MuAAAI 2024 · 15 citations
- patchDPCC: A Patchwise Deep Compression Framework for Dynamic Point CloudsZirui Pan, Mengbai Xiao, Xu Han, Dongxiao Yu et al.AAAI 2024 · 12 citations
- Efficient Hierarchical Entropy Model for Learned Point Cloud CompressionRui Song, Chunyang Fu, Shan Liu, Ge LiCVPR 2023
- Overfitted Point Cloud Attribute Codec Using Sparse Hierarchical Implicit Neural RepresentationsZhe Sun, Qiang Xu, Qi Zhang, Shan Liu et al.ACM MM 2025
