KPLM-STA: Physically-Accurate Shadow Synthesis for Human Relighting via Keypoint-Based Light Modeling
Xinhui Yin, Qifei Li, Yilin Guo, Hongxia Xie, Xiaoli Zhang
摘要
Image composition aims to seamlessly integrate a foreground object into a background, where generating realistic and geometrically accurate shadows remains a persistent challenge. While recent diffusion-based methods have outperformed GAN-based approaches, existing techniques, such as the diffusion-based relighting framework IC-Light, still fall short in producing shadows with both high appearance realism and geometric precision, especially in composite images. To address these limitations, we propose a novel shadow generation framework based on a Keypoints Linear Model (KPLM) and a Shadow Triangle Algorithm (STA). KPLM models articulated human bodies using nine keypoints and one bounding block, enabling physically plausible shadow projection and dynamic shading across joints, thereby enhancing visual realism. STA further improves geometric accuracy by computing shadow angles, lengths, and spatial positions through explicit geometric formulations. Extensive experiments demonstrate that our method achieves state-of-the-art performance on shadow realism benchmarks, particularly under complex human poses, and generalizes effectively to multi-directional relighting scenarios such as those supported by IC-Light.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
- Mask-ShadowGAN: Learning to Remove Shadows From Unpaired DataXiaowei Hu, Yitong Jiang, Chi-Wing Fu, Pheng-Ann HengICCV 2019 · 被引用 255 次
- Shadow Generation for Composite Image in Real-World ScenesYan Hong, Li Niu, Jianfu ZhangAAAI 2022 · 被引用 55 次
- Denoising Diffusion Step-aware ModelsShuai Yang, Yukang Chen, Luozhou Wang, Shu Liu 等ICLR 2024 · 被引用 27 次
相关 Paper
- Shadow Generation Using Diffusion Model with Geometry PriorHaonan Zhao, Qingyang Liu, Xinhao Tao, Li Niu 等CVPR 2025
- Foreground Harmonization and Shadow Generation for Composite ImageJing Zhou, Ziqi Yu, Zhongyun Bao, Gang Fu 等ACM MM 2024 · 被引用 7 次
- Deep Image-based Illumination HarmonizationZhongyun Bao, Chengjiang Long, Gang Fu, Daquan Liu 等CVPR 2022 · 被引用 24 次
- Joint Shadow Generation and Relighting via Light-Geometry Interaction MapsShan Wang, Peixia Li, Chenchen Xu, Ziang Cheng 等ICLR 2026
- GS-ID: Illumination Decomposition on Gaussian Splatting via Adaptive Light Aggregation and Diffusion-Guided Material PriorsKang Du, Zhihao Liang, Yulin Shen, Zeyu WangICCV 2025 · 被引用 3 次
