Polarization State Tracing for Reflection Removal and Color-Consistent Reconstruction
Dongyue Wang, Yang Lu, Jiandong Tian
Abstract
Colored glass is widely used in everyday settings, yet its reflective and absorptive properties often introduce ghost shadows and color bias in captured images. However, existing methods typically neglect the absorption issue, making it difficult to address color bias caused by colored glass. To address this, we are the first to apply polarization imaging theory to model the light transmission process within glass. Specifically, we propose a novel imaging model, the Polarization State Tracing Model (PSTM), which traces polarized light along multiple propagation paths and accounts for wavelength-selective absorption, enabling joint reflection removal and color-consistent reconstruction. Guided by PSTM, we design a Channel Ring Attention (CRA) mechanism to efficiently capture inter-angle polarization dependencies and enhance feature interaction across polarization channels, ensuring physically consistent recovery. Besides, the recovered polarization information can be directly applied to advanced downstream tasks, such as Shape-from-Polarization (SfP). We construct a real-world dataset, GlassPol, containing a wide range of glass materials, enabling testing under diverse optical conditions. Extensive experiments show that our method outperforms existing state-of-the-art methods, achieving up to a 3dB improvement in PSNR, establishing a new benchmark for polarized reflection removal.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9be17088-4708-490e-9ec9-4b7e47f8501dBuilds on20
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Uformer: A General U-Shaped Transformer for Image RestorationZhendong Wang, Xiaodong Cun, Jianmin Bao, Wengang Zhou et al.CVPR 2022 · 1,970 citations
- CLEARER: Multi-Scale Neural Architecture Search for Image RestorationYuanbiao Gou, Boyun Li, Zitao Liu, Songfan Yang et al.NeurIPS 2020 · 88 citations
- Trash or Treasure? An Interactive Dual-Stream Strategy for Single Image Reflection SeparationQiming Hu, Xiaojie GuoNeurIPS 2021 · 81 citations
- Single Image Reflection Separation via Component SynergyQiming Hu, Xiaojie GuoICCV 2023 · 63 citations
Related papers
- Glass Segmentation using Intensity and Spectral Polarization CuesHaiyang Mei, Bo Dong, Wen Dong, Jiaxi Yang et al.CVPR 2022 · 91 citations
- Multi-view Spectral Polarization Propagation for Video Glass SegmentationYu Qiao, Bo Dong, Ao Jin, Yu Fu et al.ICCV 2023 · 9 citations
- Polarized Reflection Removal With Perfect Alignment in the WildChenyang Lei, Xuhua Huang, Mengdi Zhang, Qiong Yan et al.CVPR 2020
- Fooling Polarization-Based Vision Using Locally Controllable Polarizing ProjectionZhuoxiao Li, Zhihang Zhong, Shohei Nobuhara, Ko Nishino et al.CVPR 2024
- Shape from Polarization for Complex Scenes in the WildChenyang Lei, Chenyang Qi, Jiaxin Xie, Na Fan et al.CVPR 2022 · 60 citations
