Controllable Light Diffusion for Portraits
David Futschik, Kelvin Ritland, James Vecore, Sean Fanello, Sergio Orts-Escolano, Brian Curless, Daniel Sýkora, Rohit Pandey
Abstract
Figure 1 . Our method enables control over the diffuseness of light in arbitrary portrait images. We first extract specular/shadow maps from the input image and then produce a fully diffuse image. Additionally, we show how to recover a uniformly lit image, i.e. tinted by the average light color, from which we can estimate the untinted albedo. The bottom row illustrates the application of editing the input photo by gradually increasing the amount of light diffusion.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fb225cd2-734c-4164-85c2-203f4e9bc50aCited by top-tier papers9
- DiFaReli: Diffusion Face RelightingPuntawat Ponglertnapakorn, Nontawat Tritrong, Supasorn SuwajanakornICCV 2023 · 14 citations
- Text2Relight: Creative Portrait Relighting with Text GuidanceJunuk Cha, Mengwei Ren, Krishna Kumar Singh, He Zhang et al.AAAI 2025 · 9 citations
- PI-Light: Physics-Inspired Diffusion for Full-Image RelightingZhexin Liang, Zhaoxi Chen, Yongwei Chen, Tianyi Wei et al.ICLR 2026 · 5 citations
- Structure-Guided Diffusion Models for High-Fidelity Portrait Shadow RemovalWanchang Yu, Qing Zhang, Rongjia Zheng, Wei-Shi ZhengICCV 2025 · 1 citation
- TokenLight: Precise Lighting Control in Images using Attribute TokensSumit Chaturvedi, Yannick Hold-Geoffroy, Mengwei Ren, Jingyuan Liu et al.CVPR 2026 · 1 citation
Builds on9
- Deep Single-Image Portrait RelightingHao Zhou, Sunil Hadap, Kalyan Sunkavalli, David JacobsICCV 2019 · 247 citations
- Total relighting: learning to relight portraits for background replacementRohit Pandey, Sergio Orts-Escolano, Chloe LeGendre, Christian Häne et al.SIGGRAPH 2021 · 138 citations
- Portrait shadow manipulationXuaner Cecilia Zhang, Jonathan T. Barron, Yun-Ta Tsai, Rohit Pandey et al.SIGGRAPH 2020 · 104 citations
- A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image SynthesisXingang Pan, Xudong Xu, Chen Change Loy, Christian Theobalt et al.NeurIPS 2021 · 104 citations
- Neural Video Portrait Relighting in Real-time via Consistency ModelingLongwen Zhang, Qixuan Zhang, Minye Wu, Jingyi Yu et al.ICCV 2021 · 59 citations
Related papers
- SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic FacesSumit Chaturvedi, Mengwei Ren, Yannick Hold-Geoffroy, Jingyuan Liu et al.CVPR 2025
- LightLab: Controlling Light Sources in Images with Diffusion ModelsNadav Magar, Amir Hertz, Eric Tabellion, Yael Pritch et al.SIGGRAPH 2025 · 6 citations
- Relightful Harmonization: Lighting-Aware Portrait Background ReplacementMengwei Ren, Wei Xiong, Jae Shin Yoon, Zhixin Shu et al.CVPR 2024 · 17 citations
- Parametric Shadow Control for Portrait Generation in Text-to-Image Diffusion ModelsHaoming Cai, Tsung-Wei Huang, Shiv Gehlot, Brandon Y. Feng et al.ICCV 2025 · 2 citations
- LightPainter: Interactive Portrait Relighting with Freehand ScribbleYiqun Mei, He Zhang, Xuaner Zhang, Jianming Zhang et al.CVPR 2023
