Shadow Generation with Decomposed Mask Prediction and Attentive Shadow Filling
Xinhao Tao, Junyan Cao, Yan Hong, Li Niu
Abstract
Image composition refers to inserting a foreground object into a background image to obtain a composite image. In this work, we focus on generating plausible shadows for the inserted foreground object to make the composite image more realistic. To supplement the existing small-scale dataset, we create a large-scale dataset called RdSOBA with rendering techniques. Moreover, we design a two-stage network named DMASNet with decomposed mask prediction and attentive shadow filling. Specifically, in the first stage, we decompose shadow mask prediction into box prediction and shape prediction. In the second stage, we attend to reference background shadow pixels to fill the foreground shadow. Abundant experiments prove that our DMASNet achieves better visual effects and generalizes well to real composite images.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3defb8e1-d9e7-4a17-a7f3-0c0a24bb1687Cited by top-tier papers6
- Shadow Generation for Composite Image Using Diffusion ModelQingyang Liu, Junqi You, Jianting Wang, Xinhao Tao et al.CVPR 2024 · 10 citations
- Refracting Reality: Generating Images with Realistic Transparent ObjectsYue Yin, Enze Tao, Dylan CampbellCVPR 2026 · 2 citations
- Under the Shadow: Exploiting Opacity Variation for Fine-grained Shadow DetectionXiaotian Qiao, Ke Xu, Xianglong Yang, Ruijie Dong et al.NeurIPS 2025 · 1 citation
- KPLM-STA: Physically-Accurate Shadow Synthesis for Human Relighting via Keypoint-Based Light ModelingXinhui Yin, Qifei Li, Yilin Guo, Hongxia Xie et al.AAAI 2026
- Joint Shadow Generation and Relighting via Light-Geometry Interaction MapsShan Wang, Peixia Li, Chenchen Xu, Ziang Cheng et al.ICLR 2026
Builds on15
- Distance-IoU Loss: Faster and Better Learning for Bounding Box RegressionZhaohui Zheng, Ping Wang, Wei Liu, Jinze Li et al.AAAI 2020 · 4,823 citations
- Mask-ShadowGAN: Learning to Remove Shadows From Unpaired DataXiaowei Hu, Yitong Jiang, Chi-Wing Fu, Pheng-Ann HengICCV 2019 · 255 citations
- ARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and RemovalBin Ding, Chengjiang Long, Ling Zhang, Chunxia XiaoICCV 2019 · 171 citations
- RIS-GAN: Explore Residual and Illumination with Generative Adversarial Networks for Shadow RemovalLing Zhang, Chengjiang Long, Xiaolong Zhang, Chunxia XiaoAAAI 2020 · 106 citations
- Bijective Mapping Network for Shadow RemovalYurui Zhu, Jie Huang, Xueyang Fu, Feng Zhao et al.CVPR 2022 · 97 citations
Related papers
- Shadow Generation for Composite Image in Real-World ScenesYan Hong, Li Niu, Jianfu ZhangAAAI 2022 · 55 citations
- Shadow Generation Using Diffusion Model with Geometry PriorHaonan Zhao, Qingyang Liu, Xinhao Tao, Li Niu et al.CVPR 2025
- MetaShadow: Object-Centered Shadow Detection, Removal, and SynthesisTianyu Wang, Jianming Zhang, Haitian Zheng, Zhihong Ding et al.CVPR 2025
- ShadowMover: Automatically Projecting Real Shadows onto Virtual ObjectPiaopiao Yu, Jie Guo, Fan Huang, Zhenyu Chen et al.IEEE VR 2023 · 6 citations
- CFDiffusion: Controllable Foreground Relighting in Image Compositing via Diffusion ModelZiqi Yu, Jing Zhou, Zhongyun Bao, Gang Fu et al.ACM MM 2024 · 6 citations
