SwitchLight: Co-Design of Physics-Driven Architecture and Pre-training Framework for Human Portrait Relighting
Hoon Kim, Minje Jang, Wonjun Yoon, Jisoo Lee, Donghyun Na, Sanghyun Woo
Abstract
We introduce a co-designed approach for human portrait relighting that combines a physics-guided architecture with a pretraining framework. Drawing on the Cook-Torrance reflectance model, we have meticulously configured the architecture design to precisely simulate light-surface interactions. Furthermore, to overcome the limitation of scarce high-quality lightstage data, we have developed a self-supervised pretraining strategy. This novel combination of accurate physical modeling and expanded training dataset establishes a new benchmark in relighting realism.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers41
- DiFaReli: Diffusion Face RelightingPuntawat Ponglertnapakorn, Nontawat Tritrong, Supasorn SuwajanakornICCV 2023 · 14 citations
- TC-Light: Temporally Coherent Generative Rendering for Realistic World TransferYang Liu, Chuanchen Luo, Zimo Tang, Yingyan Li et al.NeurIPS 2025 · 12 citations
- Light-X: Generative 4D Video Rendering with Camera and Illumination ControlTianqi Liu, Zhaoxi Chen, Zihao Huang, Shaocong Xu et al.ICLR 2026 · 12 citations
- UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible FeedbackPengwei Liu, Hangjie Yuan, Bo Dong, Jiazheng Xing et al.NeurIPS 2025 · 10 citations
- Text2Relight: Creative Portrait Relighting with Text GuidanceJunuk Cha, Mengwei Ren, Krishna Kumar Singh, He Zhang et al.AAAI 2025 · 9 citations
Builds on25
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- BEiT: BERT Pre-Training of Image TransformersHangbo Bao, Li Dong, Songhao Piao, Furu WeiICLR 2022 · 3,632 citations
- Deep Single-Image Portrait RelightingHao Zhou, Sunil Hadap, Kalyan Sunkavalli, David JacobsICCV 2019 · 247 citations
- Total relighting: learning to relight portraits for background replacementRohit Pandey, Sergio Orts-Escolano, Chloe LeGendre, Christian Häne et al.SIGGRAPH 2021 · 138 citations
Related papers
- Learning Physics-Guided Face Relighting Under Directional LightThomas Nestmeyer, Jean-François Lalonde, Iain A. Matthews, Andreas M. LehrmannCVPR 2020
- Lite2Relight: 3D-aware Single Image Portrait RelightingPramod Rao, Gereon Fox, Abhimitra Meka, Mallikarjun B. R. et al.SIGGRAPH 2024 · 14 citations
- Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and HarmonizationJunying Wang, Jingyuan Liu, Xin Sun, Krishna Kumar Singh et al.CVPR 2025
- Physically Controllable Relighting of PhotographsChris Careaga, Yagiz AksoySIGGRAPH 2025 · 3 citations
- RelightableHands: Efficient Neural Relighting of Articulated Hand ModelsShun Iwase, Shunsuke Saito, Tomas Simon, Stephen Lombardi et al.CVPR 2023
