Rectifying Latent Space for Generative Single-Image Reflection Removal
Mingjia Li, Jin Hu, Hainuo Wang, Qiming Hu, Jiarui Wang, Xiaojie Guo
Abstract
Single-image reflection removal is a highly ill-posed problem, where existing methods struggle to reason about the composition of corrupted regions, causing them to fail at recovery and generalization in the wild. This work reframes an editing-purpose latent diffusion model to effectively perceive and process highly ambiguous, layered image inputs, yielding high-quality outputs. We argue that the challenge of this conversion stems from a critical yet overlooked issue, i.e., the latent space of semantic encoders lacks the inherent structure to interpret a composite image as a linear superposition of its constituent layers.Our approach is built on three synergistic components, including a reflection-equivariant VAE that aligns the latent space with the linear physics of reflection formation, a learnable task-specific text embedding for precise guidance that bypasses ambiguous language, and a depth-guided early-branching sampling strategy to harness generative stochasticity for an optimal result. Extensive experiments reveal that our model achieves new state-of-the-art performance on multiple benchmarks and generalizes well to challenging real-world images. Code will be made publicly available.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 64439b8a-21fc-41a6-b9b2-7b9d01b5b2e0Builds on26
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
Related papers
- Reflection Separation from a Single Image via Joint Latent DiffusionZheng-Hui Huang, Zhixiang Wang, Yu-Lun Liu, Yung-Yu ChuangCVPR 2026
- Zero-Shot Depth Aware Image Editing With Diffusion ModelsRishubh Parihar, Sachidanand VS, R. Venkatesh BabuICCV 2025 · 3 citations
- Dereflection Any Image with Diffusion Priors and Diversified DataJichen Hu, Chen Yang, Zanwei Zhou, Jiemin Fang et al.AAAI 2026 · 7 citations
- Both Semantics and Reconstruction Matter: Making Representation Encoders Ready for Text-to-Image Generation and EditingShilong Zhang, He Zhang, Zhifei Zhang, Chongjian GE et al.ICML 2026 · 19 citations
- Single Mesh Diffusion Models with Field Latents for Texture GenerationThomas W. Mitchel, Carlos Esteves, Ameesh MakadiaCVPR 2024 · 4 citations
