SunStage: Portrait Reconstruction and Relighting Using the Sun as a Light Stage

sunstage.cs.washington.edu (a) Reconstruction (b) Edit lighting (c) Soften shadows (d) Swap lighting (e) Edit texture Figure 1. Given a selfie video rotating under the sun, SunStage reconstructs geometry, material, camera pose, and lighting information. This recovered information can be used to (a) realistically re-render the input images, (b) modify the lighting conditions by adding / removing lights, (c) soften harsh shadows by changing the size of the reconstructed light sources (d) render the person in an entirely new environment, and (e) edit the albedo or material properties to add freckles, makeup, or stickers that realistically interact with scene lighting.