LightIt: Illumination Modeling and Control for Diffusion Models
Peter Kocsis, Julien Philip, Kalyan Sunkavalli, Matthias Nießner, Yannick Hold-Geoffroy
2024Year
31Top-tier citations
Abstract
2 Adobe Research peter-kocsis.github.io/LightIt/ Figure 1. Teaser. We present LightIt, a method for explicit lighting control of text-guided image generation. Given a normal map of the desired geometry and light direction with a solid angle, we introduce a method to predict direct shading, which is then used to generate high-quality images with coherent lighting.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fb6ca0aa-acc4-4e05-b849-fb8b5ae59b62Cited by top-tier papers31
- UniRelight: Learning Joint Decomposition and Synthesis for Video RelightingKai He, Ruofan Liang, Jacob Munkberg, Jon Hasselgren et al.NeurIPS 2025 · 42 citations
- IllumiNeRF: 3D Relighting Without Inverse RenderingXiaoming Zhao, Pratul P. Srinivasan, Dor Verbin, Keunhong Park et al.NeurIPS 2024 · 34 citations
- Latent Intrinsics Emerge from Training to RelightXiao Zhang, William Gao, Seemandhar Jain, Michael Maire et al.NeurIPS 2024 · 21 citations
- IntrinsiX: High-Quality PBR Generation using Image PriorsPeter Kocsis, Lukas Höllein, Matthias NießnerNeurIPS 2025 · 20 citations
- TC-Light: Temporally Coherent Generative Rendering for Realistic World TransferYang Liu, Chuanchen Luo, Zimo Tang, Yingyan Li et al.NeurIPS 2025 · 12 citations
Builds on20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- SegFormer: Simple and Efficient Design for Semantic Segmentation with TransformersEnze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar et al.NeurIPS 2021 · 9,661 citations
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations
Related papers
- DiLightNet: Fine-grained Lighting Control for Diffusion-based Image GenerationChong Zeng, Yue Dong, Pieter Peers, Youkang Kong et al.SIGGRAPH 2024 · 41 citations
- Physically Controllable Relighting of PhotographsChris Careaga, Yagiz AksoySIGGRAPH 2025 · 3 citations
- IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video GenerationYuanze Lin, Yi-Wen Chen, Yi-Hsuan Tsai, Ronald Clark et al.NeurIPS 2025 · 6 citations
- LightPainter: Interactive Portrait Relighting with Freehand ScribbleYiqun Mei, He Zhang, Xuaner Zhang, Jianming Zhang et al.CVPR 2023
- LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene RelightingXiaoyan Xing, Konrad Groh, Sezer Karaoglu, Theo Gevers et al.CVPR 2025
