Saccade-Contingent Rendering
Yuna Kwak, Eric Penner, Xuan Wang, Mohammad R. Saeedpour-Parizi, Olivier Mercier, Xiuyun Wu, T. Scott Murdison, Phillip Guan
Abstract
Battery-constrained power consumption, compute limitations, and high frame rate requirements in head-mounted displays present unique challenges in the drive to present increasingly immersive and comfortable imagery in virtual reality. However, humans are not equally sensitive to all regions of the visual field, and perceptually-optimized rendering techniques are increasingly utilized to address these bottlenecks. Many of these techniques are gaze-contingent and often render reduced detail away from a user’s fixation. Such techniques are dependent on spatio-temporally-accurate gaze tracking and can result in obvious visual artifacts when eye tracking is inaccurate. In this work we present a gaze-contingent rendering technique which only requires saccade detection, bypassing the need for highly-accurate eye tracking. In our first experiment, we show that visual acuity is reduced for several hundred milliseconds after a saccade. In our second experiment, we use these results to reduce the rendered image resolution after saccades in a controlled psychophysical setup, and find that observers cannot discriminate between saccade-contingent, reduced-resolution rendering and full-resolution rendering under certain conditions identified in Experiment 1. Finally, in our third experiment, we introduce a 90 pixels per degree headset and validate our saccade-contingent rendering method under typical VR viewing conditions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8ea58ee9-2f67-4189-8095-57d5658c830bCited by top-tier papers2
- Process Only Where You Look: Hardware and Algorithm Co-optimization for Efficient Gaze-Tracked Foveated Rendering in Virtual RealityHaiyu Wang, Wenxuan Liu, Kenneth Chen, Qi Sun et al.ISCA 2025 · 6 citations
- Foveated Instance SegmentationHongyi Zeng, Wenxuan Liu, Tianhua Xia, Jinhui Chen et al.CVPR 2025
Builds on7
- FovVideoVDP: a visible difference predictor for wide field-of-view videoRafal K. Mantiuk, Gyorgy Denes, Alexandre Chapiro, Anton Kaplanyan et al.SIGGRAPH 2021 · 158 citations
- Event-Based Near-Eye Gaze Tracking Beyond 10, 000 HzAnastasios N. Angelopoulos, Julien N. P. Martel, Amit P. S. Kohli, Jörg Conradt et al.IEEE VR 2021 · 155 citations
- stelaCSF: a unified model of contrast sensitivity as the function of spatio-temporal frequency, eccentricity, luminance and areaRafal K. Mantiuk, Maliha Ashraf, Alexandre ChapiroSIGGRAPH 2022 · 56 citations
- Towards Attention-aware Foveated RenderingBrooke Krajancich, Petr Kellnhofer, Gordon WetzsteinSIGGRAPH 2023 · 41 citations
- A perceptual model of motion quality for rendering with adaptive refresh-rate and resolutionGyorgy Denes, Akshay Jindal, Aliaksei Mikhailiuk, Rafal K. MantiukSIGGRAPH 2020 · 40 citations
Related papers
- Eye-dominance-guided Foveated RenderingXiaoxu Meng, Ruofei Du, Amitabh VarshneyIEEE VR 2020 · 63 citations
- Low-Latency Ocular Parallax Rendering and Investigation of Its Effect on Depth Perception in Virtual RealityYuri Mikawa, Taiki FukiageIEEE VR 2024 · 3 citations
- Image features influence reaction time: a learned probabilistic perceptual model for saccade latencyBudmonde Duinkharjav, Praneeth Chakravarthula, Rachel Brown, Anjul Patney et al.SIGGRAPH 2022 · 26 citations
- Power, Performance, and Image Quality Tradeoffs in Foveated RenderingRahul Singh, Muhammad Huzaifa, Jeffrey Liu, Anjul Patney et al.IEEE VR 2023 · 31 citations
- Beyond the Blink: Investigating Combined Saccadic & Blink-Suppressed Hand Redirection in Virtual RealityAndré Zenner, Chiara Karr, Martin Feick, Oscar Ariza et al.CHI 2024 · 11 citations
