Gaze-Adaptive Foveation for Remote Rendered VR
Adhi Widagdo, Teemu Kämäräinen, Ahmad Alhilal, Matti Siekkinen, Cheng-Hsin Hsu
Abstract
Remote rendering enables high-fidelity virtual reality (VR) experiences on standalone headsets by offloading intensive graphics workloads to remote servers. However, streaming high-quality VR graphics imposes substantial bandwidth and latency challenges. Spatial compression is a form of foveation which addresses this challenge by leveraging the human visual system's varying acuity, allocating higher visual quality around the user's gaze while reducing resolution in the periphery. In this work, we implement three gaze-adaptive foveation methods: Dynamic Axis-Aligned Distortion Transmission (D-AADT2 and D-AADT3) and Dynamic Foveated Radial Warp (D-FRW)) of which only D-AADT2 has been previously presented. These methods dynamically adapt spatial compression based on gaze-tracking input, ensuring optimal perceptual quality. We integrate these methods together with their static counterparts into the open-source Air Light VR (ALVR) remote-rendering framework, enabling native (72 FPS) framerates. We conclude a comprehensive objective evaluation across diverse VR games and demonstrate that the dynamic methods significantly outperform traditional static approaches in both encoding efficiency and perceptual quality metrics. A complementary subjective user study further validates these findings, confirming that dynamic gaze-adaptive foveation substantially enhances visual quality, immersion, and user interaction experience.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 34f566ee-10ee-4921-bd0f-85f1ee022c8aBuilds on5
- FovVideoVDP: a visible difference predictor for wide field-of-view videoRafal K. Mantiuk, Gyorgy Denes, Alexandre Chapiro, Anton Kaplanyan et al.SIGGRAPH 2021 · 158 citations
- Beyond blur: real-time ventral metamers for foveated renderingDavid R. Walton, Rafael Kuffner dos Anjos, Sebastian Friston, David Swapp et al.SIGGRAPH 2021 · 60 citations
- Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality StreamingShaoyu Chen, Budmonde Duinkharjav, Xin Sun, Li-Yi Wei et al.IEEE VR 2022 · 25 citations
- Foveated Encoding for Large High-Resolution DisplaysFlorian Frieß, Matthias Braun, Valentin Bruder, Steffen Frey et al.IEEE VIS 2020 · 19 citations
- Towards Motion Metamers for Foveated RenderingTaimoor Tariq, Piotr DidykSIGGRAPH 2024 · 14 citations
Related papers
- Saliency-Guided Foveated Video Encoding for Low-Latency and Immersive Cloud VRZe Wu, Ahmad Alhilal, Yuk Hang Tsui, Wen Jye Chai et al.IEEE VR 2026
- Frame Complexity-Aware Foveated Video Encoding for Real-time High-Quality StreamingZe Wu, Ahmad Alhilal, Yuk Hang Tsui, Matti Siekkinen et al.IEEE VR 2026
- FovRL: Joint Foveation and Quality Control for Immersive VR Streaming Using Reinforcement LearningYuk Hang Tsui, Ze Wu, Ahmad Alhilal, Matti Siekkinen et al.WWW 2026 · 1 citation
- Wavelet-Based Fast Decoding of 360° VideosColin Groth, Sascha Fricke, Susana Castillo Alejandre, Marcus A. MagnorIEEE VR 2023 · 4 citations
- Deep-Saliency Foveated Ray Tracing For Real-time VR RenderingYang Gao, Wencan Li, Shiyu Liang, Weizichuan Feng et al.IEEE VR 2026
