Diffusion Renderer: Neural Inverse and Forward Rendering with Video Diffusion Models
Ruofan Liang, Zan Gojcic, Huan Ling, Jacob Munkberg, Jon Hasselgren, Chih-Hao Lin, Jun Gao, Alexander Keller, Nandita Vijaykumar, Sanja Fidler, Zian Wang
2025Year
42Top-tier citations
Abstract
Reference Inverse Rendering Forward Rendering Figure 1 . We present DIFFUSIONRENDERER, a general-purpose method for both neural inverse and forward rendering. From input images or videos, it accurately estimates geometry and material buffers, and generates photorealistic images under specified lighting conditions, offering fundamental tools for image editing applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers42
- UniRelight: Learning Joint Decomposition and Synthesis for Video RelightingKai He, Ruofan Liang, Jacob Munkberg, Jon Hasselgren et al.NeurIPS 2025 · 42 citations
- OmniVDiff: Omni Controllable Video Diffusion for Generation and UnderstandingDianbing Xi, Jiepeng Wang, Yuanzhi Liang, Xi Qiu et al.AAAI 2026 · 14 citations
- Rethinking Driving World Model as Synthetic Data Generator for Perception TasksKai Zeng, Zhanqian Wu, Kaixin Xiong, Xiaobao Wei et al.ICLR 2026 · 14 citations
- Light-X: Generative 4D Video Rendering with Camera and Illumination ControlTianqi Liu, Zhaoxi Chen, Zihao Huang, Shaocong Xu et al.ICLR 2026 · 12 citations
- DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion EnhancerYuxuan Zhang, Katarína Tóthová, Zian Wang, Kangxue Yin et al.CVPR 2026 · 10 citations
Builds on40
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
Related papers
- Uni-Renderer: Unifying Rendering and Inverse Rendering Via Dual Stream DiffusionZhifei Chen, Tianshuo Xu, Wenhang Ge, Leyi Wu et al.CVPR 2025
- MaterialPicker: Multi-Modal DiT-Based Material GenerationXiaohe Ma, Valentin Deschaintre, Milos Hasan, Fujun Luan et al.SIGGRAPH 2025 · 3 citations
- RGB↔X: Image decomposition and synthesis using material- and lighting-aware diffusion modelsZheng Zeng, Valentin Deschaintre, Iliyan Georgiev, Yannick Hold-Geoffroy et al.SIGGRAPH 2024 · 61 citations
- Channel-wise Noise Scheduled Diffusion for Inverse Rendering in Indoor ScenesJunyong Choi, Min-Cheol Sagong, SeokYeong Lee, Seung-Won Jung et al.CVPR 2025
- PhySG: Inverse Rendering With Spherical Gaussians for Physics-Based Material Editing and RelightingKai Zhang, Fujun Luan, Qianqian Wang, Kavita Bala et al.CVPR 2021
