Exploiting Human Color Discrimination for Memory- and Energy-Efficient Image Encoding in Virtual Reality
Nisarg Ujjainkar, Ethan Shahan, Kenneth Chen, Budmonde Duinkharjav, Qi Sun, Yuhao Zhu
摘要
Virtual Reality (VR) has the potential of becoming the next ubiquitous computing platform. Continued progress in the burgeoning field of VR depends critically on an efficient computing substrate. In particular, DRAM access energy is known to contribute to a significant portion of system energy. Today's framebuffer compression system alleviates the DRAM traffic by using a numerically lossless compression algorithm. Being numerically lossless, however, is unnecessary to preserve perceptual quality for humans. This paper proposes a perceptually lossless, but numerically lossy, system to compress DRAM traffic. Our idea builds on top of long-established psychophysical studies that show that humans cannot discriminate colors that are close to each other. The discrimination ability becomes even weaker (i.e., more colors are perceptually indistinguishable) in our peripheral vision. Leveraging the color discrimination (in)ability, we propose an algorithm that adjusts pixel colors to minimize the bit encoding cost without introducing visible artifacts. The algorithm is coupled with lightweight architectural support that, in real-time, reduces the DRAM traffic by 66.9% and outperforms existing framebuffer compression mechanisms by up to 20.4%. Psychophysical studies on human participants show that our system introduce little to no perceptual fidelity degradation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper7
- Coterie: Exploiting Frame Similarity to Enable High-Quality Multiplayer VR on Commodity Mobile DevicesJiayi Meng, Sibendu Paul, Y. Charlie HuASPLOS 2020 · 被引用 60 次
- Beyond blur: real-time ventral metamers for foveated renderingDavid R. Walton, Rafael Kuffner dos Anjos, Sebastian Friston, David Swapp 等SIGGRAPH 2021 · 被引用 60 次
- Q-VR: system-level design for future mobile collaborative virtual realityChenhao Xie, Xie Li, Yang Hu, Huwan Peng 等ASPLOS 2021 · 被引用 36 次
- A perceptual model for eccentricity-dependent spatio-temporal flicker fusion and its applications to foveated graphicsBrooke Krajancich, Petr Kellnhofer, Gordon WetzsteinSIGGRAPH 2021 · 被引用 36 次
- Rhythmic pixel regions: multi-resolution visual sensing system towards high-precision visual computing at low powerVenkatesh Kodukula, Alexander Shearer, Van Nguyen, Srinivas Lingutla 等ASPLOS 2021 · 被引用 17 次
相关 Paper
- HoloAR: On-the-fly Optimization of 3D Holographic Processing for Augmented RealityShulin Zhao, Haibo Zhang, Cyan Subhra Mishra, Sandeepa Bhuyan 等MICRO 2021 · 被引用 22 次
- BurstLink: Techniques for Energy-Efficient Video Display for Conventional and Virtual Reality SystemsJawad Haj-Yahya, Jisung Park, Rahul Bera, Juan Gómez-Luna 等MICRO 2021 · 被引用 5 次
- Post0-VR: Enabling Universal Realistic Rendering for Modern VR via Exploiting Architectural Similarity and Data SharingYu Wen, Chenhao Xie, Shuaiwen Leon Song, Xin FuHPCA 2023 · 被引用 4 次
- Joint neural phase retrieval and compression for energy- and computation-efficient holography on the edgeYujie Wang, Praneeth Chakravarthula, Qi Sun, Baoquan ChenSIGGRAPH 2022 · 被引用 26 次
- Déjà View: Spatio-Temporal Compute Reuse for' Energy-Efficient 360° VR Video StreamingShulin Zhao, Haibo Zhang, Sandeepa Bhuyan, Cyan Subhra Mishra 等ISCA 2020 · 被引用 29 次
