Reflection Separation from a Single Image via Joint Latent Diffusion
Zheng-Hui Huang, Zhixiang Wang, Yu-Lun Liu, Yung-Yu Chuang
Abstract
Single-image reflection separation remains challenging due to its ill-posed nature, especially under extreme conditions with strong or subtle reflections. Existing methods often struggle to recover both layers in glare or weak-reflection scenarios, because of insufficient information. This paper presents the first diffusion model explicitly fine-tuned for this task, leveraging generative diffusion priors for robust separation. Our method simultaneously generates transmission and reflection layers through a unified diffusion model, incorporating a novel cross-layer self-attention mechanism for better feature disentanglement. We further introduce a disjoint sampling strategy to iteratively reduce interference between the layers during diffusion and a latent optimization step with a learned composition function for improved results in complex real-world scenarios. Extensive experiments show our approach achieves superior separation performance on multiple real-world benchmarks and surpasses state-of-the-art methods in both quantitative metrics and perceptual quality.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on36
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion ModelsAlexander Quinn Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam et al.ICML 2022 · 4,691 citations
Related papers
- Rectifying Latent Space for Generative Single-Image Reflection RemovalMingjia Li, Jin Hu, Hainuo Wang, Qiming Hu et al.CVPR 2026 · 2 citations
- ReflexSplit: Single Image Reflection Separation via Layer Fusion-SeparationChia-Ming Lee, Yu-Fan Lin, Jin-Hui Jiang, Yu-Jou Hsiao et al.CVPR 2026 · 1 citation
- Flash-Split: 2D Reflection Removal with Flash Cues and Latent Diffusion SeparationTianfu Wang, Mingyang Xie, Haoming Cai, Sachin Shah et al.CVPR 2025
- Dereflection Any Image with Diffusion Priors and Diversified DataJichen Hu, Chen Yang, Zanwei Zhou, Jiemin Fang et al.AAAI 2026 · 7 citations
- Language-guided Image Reflection SeparationHaofeng Zhong, Yuchen Hong, Shuchen Weng, Jinxiu Liang et al.CVPR 2024 · 14 citations
