Seeing the World through Your Eyes
Hadi Alzayer, Kevin Zhang, Brandon Y. Feng, Christopher A. Metzler, Jia-Bin Huang
2024Year
3Top-tier citations
Abstract
Input frames Input frames Cropped eye images Cropped eye images Novel view rendering Novel view rendering Figure 1. Radiance field reconstruction using eye reflections. The human eye is highly reflective. We show that from a sequence of frames that capture a moving head, we can reconstruct the radiance field and render the scene of what the person is observing using only the reflections off their eyes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 92d04ec3-24f5-451a-ab32-937086b09f63Cited by top-tier papers3
- Temporally Consistent Atmospheric Turbulence Mitigation with Neural RepresentationsHaoming Cai, Jingxi Chen, Brandon Y. Feng, Weiyun Jiang et al.NeurIPS 2024 · 7 citations
- HiFiGaze: Improving Eye Tracking Accuracy Using Screen Content KnowledgeTaejun Kim, Vimal Mollyn, Riku Arakawa, Chris HarrisonCHI 2026 · 2 citations
- ViewMask-1-to-3: Multi-View Consistent Image Generation via Multimodal Discrete Diffusion ModelsRuishu Zhu, Zhihao Huang, Jiacheng Sun, Ping Luo et al.ICML 2026 · 1 citation
Builds on18
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- Plenoxels: Radiance Fields without Neural NetworksSara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen et al.CVPR 2022 · 1,237 citations
Related papers
- Monocular Reconstruction of Neural Face Reflectance FieldsMallikarjun B. R., Ayush Tewari, Tae-Hyun Oh, Tim Weyrich et al.CVPR 2021
- HRAvatar: High-Quality and Relightable Gaussian Head AvatarDongbin Zhang, Yunfei Liu, Lijian Lin, Ye Zhu et al.CVPR 2025
- EyeNeRF: a hybrid representation for photorealistic synthesis, animation and relighting of human eyesGengyan Li, Abhimitra Meka, Franziska Mueller, Marcel C. Bühler et al.SIGGRAPH 2022 · 39 citations
- High-Quality Facial Geometry and Appearance Capture at HomeYuxuan Han, Junfeng Lyu, Feng XuCVPR 2024
- DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and RenderingRuizhi Shao, Hongwen Zhang, He Zhang, Mingjia Chen et al.CVPR 2022 · 72 citations
