Gaze-Adaptive Foveation for Remote Rendered VR
Adhi Widagdo, Teemu Kämäräinen, Ahmad Alhilal, Matti Siekkinen, Cheng-Hsin Hsu
摘要
Remote rendering enables high-fidelity virtual reality (VR) experiences on standalone headsets by offloading intensive graphics workloads to remote servers. However, streaming high-quality VR graphics imposes substantial bandwidth and latency challenges. Spatial compression is a form of foveation which addresses this challenge by leveraging the human visual system's varying acuity, allocating higher visual quality around the user's gaze while reducing resolution in the periphery. In this work, we implement three gaze-adaptive foveation methods: Dynamic Axis-Aligned Distortion Transmission (D-AADT2 and D-AADT3) and Dynamic Foveated Radial Warp (D-FRW)) of which only D-AADT2 has been previously presented. These methods dynamically adapt spatial compression based on gaze-tracking input, ensuring optimal perceptual quality. We integrate these methods together with their static counterparts into the open-source Air Light VR (ALVR) remote-rendering framework, enabling native (72 FPS) framerates. We conclude a comprehensive objective evaluation across diverse VR games and demonstrate that the dynamic methods significantly outperform traditional static approaches in both encoding efficiency and perceptual quality metrics. A complementary subjective user study further validates these findings, confirming that dynamic gaze-adaptive foveation substantially enhances visual quality, immersion, and user interaction experience.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- FovVideoVDP: a visible difference predictor for wide field-of-view videoRafal K. Mantiuk, Gyorgy Denes, Alexandre Chapiro, Anton Kaplanyan 等SIGGRAPH 2021 · 被引用 158 次
- Beyond blur: real-time ventral metamers for foveated renderingDavid R. Walton, Rafael Kuffner dos Anjos, Sebastian Friston, David Swapp 等SIGGRAPH 2021 · 被引用 60 次
- Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality StreamingShaoyu Chen, Budmonde Duinkharjav, Xin Sun, Li-Yi Wei 等IEEE VR 2022 · 被引用 25 次
- Foveated Encoding for Large High-Resolution DisplaysFlorian Frieß, Matthias Braun, Valentin Bruder, Steffen Frey 等IEEE VIS 2020 · 被引用 19 次
- Towards Motion Metamers for Foveated RenderingTaimoor Tariq, Piotr DidykSIGGRAPH 2024 · 被引用 14 次
相关 Paper
- Saliency-Guided Foveated Video Encoding for Low-Latency and Immersive Cloud VRZe Wu, Ahmad Alhilal, Yuk Hang Tsui, Wen Jye Chai 等IEEE VR 2026
- Frame Complexity-Aware Foveated Video Encoding for Real-time High-Quality StreamingZe Wu, Ahmad Alhilal, Yuk Hang Tsui, Matti Siekkinen 等IEEE VR 2026
- FovRL: Joint Foveation and Quality Control for Immersive VR Streaming Using Reinforcement LearningYuk Hang Tsui, Ze Wu, Ahmad Alhilal, Matti Siekkinen 等WWW 2026 · 被引用 1 次
- Wavelet-Based Fast Decoding of 360° VideosColin Groth, Sascha Fricke, Susana Castillo Alejandre, Marcus A. MagnorIEEE VR 2023 · 被引用 4 次
- Deep-Saliency Foveated Ray Tracing For Real-time VR RenderingYang Gao, Wencan Li, Shiyu Liang, Weizichuan Feng 等IEEE VR 2026
