KPLM-STA: Physically-Accurate Shadow Synthesis for Human Relighting via Keypoint-Based Light Modeling
Xinhui Yin, Qifei Li, Yilin Guo, Hongxia Xie, Xiaoli Zhang
Abstract
Image composition aims to seamlessly integrate a foreground object into a background, where generating realistic and geometrically accurate shadows remains a persistent challenge. While recent diffusion-based methods have outperformed GAN-based approaches, existing techniques, such as the diffusion-based relighting framework IC-Light, still fall short in producing shadows with both high appearance realism and geometric precision, especially in composite images. To address these limitations, we propose a novel shadow generation framework based on a Keypoints Linear Model (KPLM) and a Shadow Triangle Algorithm (STA). KPLM models articulated human bodies using nine keypoints and one bounding block, enabling physically plausible shadow projection and dynamic shading across joints, thereby enhancing visual realism. STA further improves geometric accuracy by computing shadow angles, lengths, and spatial positions through explicit geometric formulations. Extensive experiments demonstrate that our method achieves state-of-the-art performance on shadow realism benchmarks, particularly under complex human poses, and generalizes effectively to multi-directional relighting scenarios such as those supported by IC-Light.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on10
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- Mask-ShadowGAN: Learning to Remove Shadows From Unpaired DataXiaowei Hu, Yitong Jiang, Chi-Wing Fu, Pheng-Ann HengICCV 2019 · 255 citations
- Shadow Generation for Composite Image in Real-World ScenesYan Hong, Li Niu, Jianfu ZhangAAAI 2022 · 55 citations
- Denoising Diffusion Step-aware ModelsShuai Yang, Yukang Chen, Luozhou Wang, Shu Liu et al.ICLR 2024 · 27 citations
Related papers
- Shadow Generation Using Diffusion Model with Geometry PriorHaonan Zhao, Qingyang Liu, Xinhao Tao, Li Niu et al.CVPR 2025
- Foreground Harmonization and Shadow Generation for Composite ImageJing Zhou, Ziqi Yu, Zhongyun Bao, Gang Fu et al.ACM MM 2024 · 7 citations
- Deep Image-based Illumination HarmonizationZhongyun Bao, Chengjiang Long, Gang Fu, Daquan Liu et al.CVPR 2022 · 24 citations
- Joint Shadow Generation and Relighting via Light-Geometry Interaction MapsShan Wang, Peixia Li, Chenchen Xu, Ziang Cheng et al.ICLR 2026
- GS-ID: Illumination Decomposition on Gaussian Splatting via Adaptive Light Aggregation and Diffusion-Guided Material PriorsKang Du, Zhihao Liang, Yulin Shen, Zeyu WangICCV 2025 · 3 citations
