HGC-Avatar: Hierarchical Gaussian Compression for Streamable Dynamic 3D Avatars
Haocheng Tang, Ruoke Yan, Xinhui Yin, Qi Zhang, Xinfeng Zhang, Siwei Ma, Wen Gao, Chuanmin Jia
Abstract
Recent advances in 3D Gaussian Splatting (3DGS) have enabled fast, photorealistic rendering of dynamic 3D scenes, showing strong potential in immersive communication. However, in digital human encoding and transmission, the compression methods based on general 3DGS representations are limited by the lack of human priors, resulting in suboptimal bitrate efficiency and reconstruction quality at the decoder side, which hinders their application in streamable 3D avatar systems. We propose HGC-Avatar, a novel Hierarchical Gaussian Compression framework designed for efficient transmission and high-quality rendering of dynamic avatars. Our method disentangles the Gaussian representation into a structural layer, which maps poses to Gaussians via a StyleUNet-based generator, and a motion layer, which leverages the SMPL-X model to represent temporal pose variations compactly and semantically. This hierarchical design supports layer-wise compression, progressive decoding, and controllable rendering from diverse pose inputs such as video sequences or text. Since people are most concerned with facial realism, we incorporate a facial attention mechanism during StyleUNet training to preserve identity and expression details under low-bitrate constraints. Experimental results demonstrate that HGC-Avatar provides a streamable solution for rapid 3D avatar rendering, while significantly outperforming prior methods in both visual quality and compression efficiency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- GauMVC: Generative Decoupled Gaussian Representation for Human-centric Multi-view Video CompressionRuoke Yan, Mingjia Yang, Xinfeng Zhang, Haocheng Tang et al.CVPR 2026
- Hyperbolic Hierarchical Alignment Reasoning Network for Text-3D RetrievalWenrui Li, Yidan Lu, Yeyu Chai, Rui Zhao et al.AAAI 2026
- Illumination-Consistent Human-Scene Reconstruction from Monocular VideoRongbin Zheng, Wensheng Li, Lingzhe Zeng, Dong Wang et al.CVPR 2026
Builds on30
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- CLIPScore: A Reference-free Evaluation Metric for Image CaptioningJack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras et al.EMNLP 2021 · 937 citations
- LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPSZhiwen Fan, Kevin Wang, Kairun Wen, Zehao Zhu et al.NeurIPS 2024 · 681 citations
- Animatable Neural Radiance Fields for Modeling Dynamic Human BodiesSida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang et al.ICCV 2021 · 461 citations
- Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and PruningElias Frantar, Dan AlistarhNeurIPS 2022 · 440 citations
Related papers
- TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian SplattingJianchuan Chen, Jingchuan Hu, Gaige Wang, Zhonghua Jiang et al.CVPR 2025
- ScaffoldAvatar: High-Fidelity Gaussian Avatars with Patch ExpressionsShivangi Aneja, Sebastian Weiss, Irene Baeza, Prashanth Chandran et al.SIGGRAPH 2025 · 6 citations
- E3Gen: Efficient, Expressive and Editable Avatars GenerationWeitian Zhang, Yichao Yan, Yunhui Liu, Xingdong Sheng et al.ACM MM 2024 · 4 citations
- HyperGaussians: High-Dimensional Gaussian Splatting for High-Fidelity Animatable Face AvatarsGent Serifi, Marcel C. BühlerCVPR 2026 · 4 citations
- SplattingAvatar: Realistic Real-Time Human Avatars With Mesh-Embedded Gaussian SplattingZhijing Shao, Zhaolong Wang, Zhuang Li, Duotun Wang et al.CVPR 2024 · 92 citations
