Efficient Hierarchical Entropy Model for Learned Point Cloud Compression
Rui Song, Chunyang Fu, Shan Liu, Ge Li
Abstract
Learning an accurate entropy model is a fundamental way to remove the redundancy in point cloud compression. Recently, the octree-based auto-regressive entropy model which adopts the self-attention mechanism to explore dependencies in a large-scale context is proved to be promising. However, heavy global attention computations and auto-regressive contexts are inefficient for practical applications. To improve the efficiency of the attention model, we propose a hierarchical attention structure that has a linear complexity to the context scale and maintains the global receptive field. Furthermore, we present a grouped context structure to address the serial decoding issue caused by the auto-regression while preserving the compression performance. Experiments demonstrate that the proposed entropy model achieves superior rate-distortion performance and significant decoding latency reduction compared with the state-of-the-art large-scale auto-regressive entropy model.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8bdc5a8e-4285-4f15-8eda-0aa4d2aa1f9cCited by top-tier papers12
- ROI-Guided Point Cloud Geometry Compression Towards Human and Machine VisionLiang Xie, Wei Gao, Huiming Zheng, Ge LiACM MM 2024 · 51 citations
- SCP: Spherical-Coordinate-Based Learned Point Cloud CompressionAo Luo, Linxin Song, Keisuke Nonaka, Kyohei Unno et al.AAAI 2024 · 27 citations
- UniPCGC: Towards Practical Point Cloud Geometry Compression via an Efficient Unified ApproachKangli Wang, Wei GaoAAAI 2025 · 17 citations
- AdaDPCC: Adaptive Rate Control and Rate-Distortion-Complexity Optimization for Dynamic Point Cloud CompressionChenhao Zhang, Wei GaoAAAI 2025 · 8 citations
- AnyPcc: Compressing Any Point Cloud with a Single Universal ModelKangli Wang, Qianxi Yi, Yuqi Ye, Shihao Li et al.CVPR 2026 · 4 citations
Builds on18
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without ConvolutionsWenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan et al.ICCV 2021 · 4,909 citations
- SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR SequencesJens Behley, Martin Garbade, Andres Milioto, Jan Quenzel et al.ICCV 2019 · 2,345 citations
- Swin Transformer V2: Scaling Up Capacity and ResolutionZe Liu, Han Hu, Yutong Lin, Zhuliang Yao et al.CVPR 2022 · 2,138 citations
- Multiscale Vision TransformersHaoqi Fan, Bo Xiong, Karttikeya Mangalam, Yanghao Li et al.ICCV 2021 · 1,611 citations
Related papers
- PACE: Post-Causal Entropy Modeling for Learned LiDAR Point Cloud CompressionJiahao Zhu, Kang You, Dandan Ding, Zhan MaICML 2026
- OctAttention: Octree-Based Large-Scale Contexts Model for Point Cloud CompressionChunyang Fu, Ge Li, Rui Song, Wei Gao et al.AAAI 2022 · 191 citations
- TopNet: Transformer-Efficient Occupancy Prediction Network for Octree-Structured Point Cloud Geometry CompressionXinjie Wang, Yifan Zhang, Ting Liu, Xinpu Liu et al.CVPR 2025
- OctFormer: Efficient Octree-Based Transformer for Point Cloud Compression with Local EnhancementMingyue Cui, Junhua Long, Mingjian Feng, Boyang Li et al.AAAI 2023 · 56 citations
- VoxelContext-Net: An Octree Based Framework for Point Cloud CompressionZizheng Que, Guo Lu, Dong XuCVPR 2021
