Metameric Varifocal Holograms
David R. Walton, Koray Kavakli, Rafael Kuffner dos Anjos, David Swapp, Tim Weyrich, Hakan Urey, Anthony Steed, Tobias Ritschel, Kaan Aksit
Abstract
Computer-Generated Holography (CGH) offers the potential for genuine, high-quality three-dimensional visuals. However, fulfilling this potential remains a practical challenge due to computational complexity and visual quality issues. We propose a new CGH method that exploits gaze-contingency and perceptual graphics to accelerate the development of practical holographic display systems. Firstly, our method infers the user’s focal depth and generates images only at their focus plane without using any moving parts. Second, the images displayed are metamers; in the user’s peripheral vision, they need only be statistically correct and blend with the fovea seamlessly. Unlike previous methods, our method prioritises and improves foveal visual quality without causing perceptually visible distortions at the periphery. To enable our method, we introduce a novel metameric loss function that robustly compares the statistics of two given images for a known gaze location. In parallel, we implement a model representing the relation between holograms and their image reconstructions. We couple our differentiable loss function and model to metameric varifocal holograms using a stochastic gradient descent solver. We evaluate our method with an actual proof-of-concept holographic display, and we show that our CGH method leads to practical and perceptually three-dimensional image reconstructions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on4
- Event-Based Near-Eye Gaze Tracking Beyond 10, 000 HzAnastasios N. Angelopoulos, Julien N. P. Martel, Amit P. S. Kohli, Jörg Conradt et al.IEEE VR 2021 · 155 citations
- Toward Standardized Classification of Foveated DisplaysJosef B. Spjut, Ben Boudaoud, Jonghyun Kim, Trey Greer et al.IEEE VR 2020 · 21 citations
- DCGH: Dynamic Computer Generated Holography for Speckle-Free, High Fidelity 3D DisplaysVincent R. Curtis, Nicholas W. Caira, Jiayi Xu, Asha Gowda Sata et al.IEEE VR 2021 · 21 citations
- FOCAS: Practical Video Super Resolution using Foveated RenderingLingdong Wang, Mohammad H. Hajiesmaili, Ramesh K. SitaramanACM MM 2021 · 21 citations
Related papers
- Holographic Parallax Improves 3D Perceptual RealismDongyeon Kim, Seung-Woo Nam, Suyeon Choi, Jong-Mo Seo et al.SIGGRAPH 2024 · 32 citations
- Beyond blur: real-time ventral metamers for foveated renderingDavid R. Walton, Rafael Kuffner dos Anjos, Sebastian Friston, David Swapp et al.SIGGRAPH 2021 · 60 citations
- Holographic Glasses for Virtual RealityJonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan Peng et al.SIGGRAPH 2022 · 54 citations
- Video See-Through Mixed Reality with Focus CuesChristoph Ebner, Shohei Mori, Peter Mohr, Yifan Peng et al.IEEE VR 2022 · 24 citations
- Accommodative holography: improving accommodation response for perceptually realistic holographic displaysDongyeon Kim, Seung-Woo Nam, Byounghyo Lee, Jong-Mo Seo et al.SIGGRAPH 2022 · 16 citations
