Implicit Surface Compression - with Good Old Discrete Cosine Transform and Motion Compensation
Tao Jin, Shengxi Wu, Tianshu Huang, Mallesham Dasari, Srinivasan Seshan, Anthony Rowe
摘要
The rapid adoption of volumetric capture technologies has created a pressing need for efficient storage and streaming of dynamic 3D content. Unfortunately, current compression standards often treat dynamic sequences as independent frames or rely on computationally expensive non-rigid registration, making them unsuitable for real-time applications or large-scale environments. In this paper, we present a novel end-to-end compression framework for dynamic Truncated Signed Distance Field volumes derived from captured 3D content, leveraging a representation that is temporally stable, easily parallelizable, and already widely used in scene reconstruction and volumetric fusion pipelines. We then adapt classic 2D video coding paradigms such as spatial coding via Discrete Cosine Transform and temporal coding using a real-time motion compensation pipeline to provide robust, real-time, and training-free encoding and decoding for 3D content. Extensive evaluations on human performance captures demonstrate that our codec achieves 35% bitrate savings at equal distortion while operating in real time at 30 FPS, while stronger temporal coherence in large-scale synthetic environments yields up to 12× bitrate reduction at equal distortion.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman 等ICCV 2021 · 被引用 2,700 次
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt 等NeurIPS 2021 · 被引用 2,500 次
- UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View ReconstructionMichael Oechsle, Songyou Peng, Andreas GeigerICCV 2021 · 被引用 885 次
- Depth Anything: Unleashing the Power of Large-Scale Unlabeled DataLihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu 等CVPR 2024 · 被引用 847 次
相关 Paper
- Deep Implicit Volume CompressionDanhang Tang, Saurabh Singh, Philip A. Chou, Christian Häne 等CVPR 2020
- TSMC: Time-varying 4D Scene Mesh CompressionGuodong Chen, Libor Vása, Amrita Mazumdar, Mallesham DasariSIGGRAPH 2026
- TSDF-Based Efficient Motion-Compensated Temporal Interpolation for 3D Dynamic SequencesSoowoong Kim, Minseong Kwon, Junho Choi, Gun Bang 等AAAI 2025 · 被引用 1 次
- SmoothMotionVectors: Optimizing Your Content for Video Codecs in Free View Video CompressionMingyang Song, Yang Zhang, Siyu Tang, Tunç Ozan AydinSIGGRAPH 2026
- Temporal Smoothness-Aware Rate-Distortion Optimized 4D Gaussian SplattingHyeongmin Lee, Kyungjune BaekNeurIPS 2025 · 被引用 3 次
