No Shadow Left Behind: Removing Objects and Their Shadows Using Approximate Lighting and Geometry

We present a method to remove an object and its shadows from an image, to enable applications like home refurnishing. Our method takes as input an image, approximate scene lighting and geometry, and an object mask, and generates a new version of the image that depicts the scene as if the object had not been present. This not only includes inpainting the occluded pixels, but removing any shadows cast by the object.