CVPR2024

Seeing the World through Your Eyes

Hadi Alzayer, Kevin Zhang, Brandon Y. Feng, Christopher A. Metzler, Jia-Bin Huang

Abstract

Input frames Input frames Cropped eye images Cropped eye images Novel view rendering Novel view rendering Figure 1. Radiance field reconstruction using eye reflections. The human eye is highly reflective. We show that from a sequence of frames that capture a moving head, we can reconstruct the radiance field and render the scene of what the person is observing using only the reflections off their eyes.