POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling
Zhuo Chen, Chengqun Yang, Zhuo Su, Zheng Lv, Jingnan Gao, Xiaoyuan Zhang, Xiaokang Yang, Yichao Yan
Abstract
Face relighting aims to synthesize realistic portraits under novel illumination while preserving identity and geometry. However, progress remains constrained by the limited availability of large-scale, physically consistent illumination data. To address this, we introduce POLAR, a large-scale and physically calibrated One-Light-at-a-Time (OLAT) dataset containing over 200 subjects captured under 156 lighting directions, multiple views, and diverse expressions. Building upon POLAR, we develop a flow-based generative model POLARNet that predicts per-light OLAT responses from a single portrait, capturing fine-grained and direction-aware illumination effects while preserving facial identity. Unlike diffusion or background-conditioned methods that rely on statistical or contextual cues, our formulation models illumination as a continuous, physically interpretable transformation between lighting states, enabling scalable and controllable relighting. Together, POLAR and POLARNet form a unified illumination learning framework that links real data, generative synthesis, and physically grounded relighting, establishing a self-sustaining"chicken-and-egg"cycle for scalable and reproducible portrait illumination. Our project page: https://rex0191.github.io/POLAR/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on41
- NeRD: Neural Reflectance Decomposition from Image CollectionsMark Boss, Raphael Braun, Varun Jampani, Jonathan T. Barron et al.ICCV 2021 · 608 citations
- Extracting Triangular 3D Models, Materials, and Lighting From ImagesJacob Munkberg, Wenzheng Chen, Jon Hasselgren, Alex Evans et al.CVPR 2022 · 306 citations
- Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and DenoisingJon Hasselgren, Nikolai Hofmann, Jacob MunkbergNeurIPS 2022 · 234 citations
- Total relighting: learning to relight portraits for background replacementRohit Pandey, Sergio Orts-Escolano, Chloe LeGendre, Christian Häne et al.SIGGRAPH 2021 · 138 citations
- Neural Gaffer: Relighting Any Object via DiffusionHaian Jin, Yuan Li, Fujun Luan, Yuanbo Xiangli et al.NeurIPS 2024 · 112 citations
Related papers
- Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid DatasetYiqun Mei, Mingming He, Li Ma, Julien Philip et al.CVPR 2025
- Neural Video Portrait Relighting in Real-time via Consistency ModelingLongwen Zhang, Qixuan Zhang, Minye Wu, Jingyi Yu et al.ICCV 2021 · 59 citations
- HumanOLAT: A Large-Scale Dataset for Full-Body Human Relighting and Novel-View SynthesisTimo Teufel, Pulkit Gera, Xilong Zhou, Umar Iqbal et al.ICCV 2025 · 1 citation
- Lite2Relight: 3D-aware Single Image Portrait RelightingPramod Rao, Gereon Fox, Abhimitra Meka, Mallikarjun B. R. et al.SIGGRAPH 2024 · 14 citations
- RelightAnyone: A Generalized Relightable 3D Gaussian Head ModelYingyan Xu, Pramod Rao, Sebastian Weiss, Gaspard Zoss et al.CVPR 2026
