LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fields

Realistic relighting Figure 1. Given small sets of images (e.g., 4 to 8), LIRM progressively reconstructs view-dependent radiance fields, geometry and material reflectance in less than a second through a feed-forward transformer, enabling realistic rendering under novel lighting conditions. All relighting examples are reconstructed from real images in Stanford-ORB [35] and DTC datasets [17].