Towards Edge Holography via Implicit Neural Representation and Compression
Hyunmin Ban, Wenbin Zhou, Yifan Peng
Abstract
Holographic displays offer the promise of realistic 3D visualization for virtual and augmented wearable solutions. Nevertheless, existing computer-generated holography (CGH) methods often struggle with either a high computational burden or limited display realism. While the emerging cloud-edge computing mechanism can enable the real-time streaming of holograms, classic image compression techniques struggle to efficiently encode and decode the substantial high-frequency information inherent in hologram data. In light of these challenges, we present a display-aware and lightweight CGH framework, leveraging implicit neural representations (INRs) and camera-calibrated wave propagation, to generate and compress high-fidelity phase-only holograms. Specifically, our approach interprets hologram generation as a continuous function approximation problem, enabling the network, with reduced parameters, to effectively learn the inherent periodicity and high-frequency components of 2D and 3D hologram data. To enable efficient deployment, we further incorporate quantization-aware training, followed by entropy coding. Experimental results evaluated on an unfiltered holographic display prototype demonstrate that the proposed INR-CGH retains image quality comparable to that of existing optimization-based methods in both 2D and 3D scenarios. In addition, our compact INR representation achieves up to 11× compression rate with minimal quality degradation and can be further reduced via quantization-aware training. The resulting model enables ≥250 fps in decoding speed, paving the way towards edge holography.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get abd4373d-ece8-4d52-b577-b72793b029d9Cited by top-tier papers1
Ask how each one uses itRelated papers
- Joint neural phase retrieval and compression for energy- and computation-efficient holography on the edgeYujie Wang, Praneeth Chakravarthula, Qi Sun, Baoquan ChenSIGGRAPH 2022 · 26 citations
- NHVC: Neural Holographic Video Compression with Scalable ArchitectureHyunmin Ban, Seungmi Choi, Jun Yeong Cha, Yeongwoong Kim et al.IEEE VR 2024 · 6 citations
- SINR: Sparsity Driven Compressed Implicit Neural RepresentationsDhananjaya Jayasundara, Sudarshan Rajagopalan, Yasiru Ranasinghe, Trac D. Tran et al.CVPR 2025
- Rate-aware Compression for NeRF-based Volumetric VideoZhiyu Zhang, Guo Lu, Huanxiong Liang, Zhengxue Cheng et al.ACM MM 2024 · 3 citations
- Time-multiplexed Neural Holography: A Flexible Framework for Holographic Near-eye Displays with Fast Heavily-quantized Spatial Light ModulatorsSuyeon Choi, Manu Gopakumar, Yifan Peng, Jonghyun Kim et al.SIGGRAPH 2022 · 84 citations
