Exploiting Human Color Discrimination for Memory- and Energy-Efficient Image Encoding in Virtual Reality
Nisarg Ujjainkar, Ethan Shahan, Kenneth Chen, Budmonde Duinkharjav, Qi Sun, Yuhao Zhu
Abstract
Virtual Reality (VR) has the potential of becoming the next ubiquitous computing platform. Continued progress in the burgeoning field of VR depends critically on an efficient computing substrate. In particular, DRAM access energy is known to contribute to a significant portion of system energy. Today's framebuffer compression system alleviates the DRAM traffic by using a numerically lossless compression algorithm. Being numerically lossless, however, is unnecessary to preserve perceptual quality for humans. This paper proposes a perceptually lossless, but numerically lossy, system to compress DRAM traffic. Our idea builds on top of long-established psychophysical studies that show that humans cannot discriminate colors that are close to each other. The discrimination ability becomes even weaker (i.e., more colors are perceptually indistinguishable) in our peripheral vision. Leveraging the color discrimination (in)ability, we propose an algorithm that adjusts pixel colors to minimize the bit encoding cost without introducing visible artifacts. The algorithm is coupled with lightweight architectural support that, in real-time, reduces the DRAM traffic by 66.9% and outperforms existing framebuffer compression mechanisms by up to 20.4%. Psychophysical studies on human participants show that our system introduce little to no perceptual fidelity degradation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ca32e2a1-b6ac-48a3-a232-b921c13c810cCited by top-tier papers1
Ask how each one uses itBuilds on7
- Coterie: Exploiting Frame Similarity to Enable High-Quality Multiplayer VR on Commodity Mobile DevicesJiayi Meng, Sibendu Paul, Y. Charlie HuASPLOS 2020 · 60 citations
- Beyond blur: real-time ventral metamers for foveated renderingDavid R. Walton, Rafael Kuffner dos Anjos, Sebastian Friston, David Swapp et al.SIGGRAPH 2021 · 60 citations
- Q-VR: system-level design for future mobile collaborative virtual realityChenhao Xie, Xie Li, Yang Hu, Huwan Peng et al.ASPLOS 2021 · 36 citations
- A perceptual model for eccentricity-dependent spatio-temporal flicker fusion and its applications to foveated graphicsBrooke Krajancich, Petr Kellnhofer, Gordon WetzsteinSIGGRAPH 2021 · 36 citations
- Rhythmic pixel regions: multi-resolution visual sensing system towards high-precision visual computing at low powerVenkatesh Kodukula, Alexander Shearer, Van Nguyen, Srinivas Lingutla et al.ASPLOS 2021 · 17 citations
Related papers
- HoloAR: On-the-fly Optimization of 3D Holographic Processing for Augmented RealityShulin Zhao, Haibo Zhang, Cyan Subhra Mishra, Sandeepa Bhuyan et al.MICRO 2021 · 22 citations
- BurstLink: Techniques for Energy-Efficient Video Display for Conventional and Virtual Reality SystemsJawad Haj-Yahya, Jisung Park, Rahul Bera, Juan Gómez-Luna et al.MICRO 2021 · 5 citations
- Post0-VR: Enabling Universal Realistic Rendering for Modern VR via Exploiting Architectural Similarity and Data SharingYu Wen, Chenhao Xie, Shuaiwen Leon Song, Xin FuHPCA 2023 · 4 citations
- Joint neural phase retrieval and compression for energy- and computation-efficient holography on the edgeYujie Wang, Praneeth Chakravarthula, Qi Sun, Baoquan ChenSIGGRAPH 2022 · 26 citations
- Déjà View: Spatio-Temporal Compute Reuse for' Energy-Efficient 360° VR Video StreamingShulin Zhao, Haibo Zhang, Sandeepa Bhuyan, Cyan Subhra Mishra et al.ISCA 2020 · 29 citations
