SAMVSR: Leveraging Semantic Priors to Zone-Focused Mamba for Video Snow Removal
Hongtao Wu, Yifeng Wu, Jiaxuan Jiang, Chengyu Wu, Hong Wang, Yefeng Zheng
Abstract
The outdoor vision systems are frequently degraded by snow particles, which obscure scene content and impair the performance of downstream vision tasks. While previous methods rely on physical priors, their performance often deteriorates under real-world conditions. Recently, semantic priors have proven effective in guiding image restoration, especially with the advent of the Segment Anything Model (SAM), which provides robust segmentation masks under adverse weather. However, leveraging SAM in video restoration remains underexplored due to the temporal inconsistency of inter-frame segmentation. In this work, we carefully construct the first framework to incorporate SAM-derived semantic priors into video snow removal, called SAMVSR. Specifically, to address temporal SAM label misalignment, we introduce an Entropy-wise Zone Propagation technique, which selects a reliable reference mask and semantically aligns instances across different frames via an entropy-guided label matching mechanism. Based on the aligned SAM semantic priors, we propose a Zone-Focused Mamba module, a novel Mamba-based architecture that restricts its scanning scope to semantically coherent zones, effectively mitigating irrelevant interactions and enhancing temporal-spatial consistency. Extensive experiments on both synthetic and real-world benchmarks finely validate the superiority of our proposed SAMVSR over existing state-of-the-art video desnowing techniques.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get eddd8b03-bb70-471f-aad0-90b981256ea3Cited by top-tier papers1
Ask how each one uses itRelated papers
- Distilling Semantic Priors from SAM to Efficient Image Restoration ModelsQuan Zhang, Xiaoyu Liu, Wei Li, Hanting Chen et al.CVPR 2024 · 20 citations
- SAM-DAQ: Segment Anything Model with Depth-guided Adaptive Queries for RGB-D Video Salient Object DetectionJia Lin, Xiaofei Zhou, Jiyuan Liu, Runmin Cong et al.AAAI 2026
- MPG-SAM 2: Adapting SAM 2 with Mask Priors and Global Context for Referring Video Object SegmentationFu Rong, Meng Lan, Qian Zhang, Lefei ZhangICCV 2025 · 4 citations
- RoSAMDepth: Robust Self-supervised Depth Estimation Leveraging Segment Anything ModelXuanang Gao, Zhiwei Ning, Gengming Zhang, Jiaxi Cao et al.CVPR 2026
- Matching Anything by Segmenting AnythingSiyuan Li, Lei Ke, Martin Danelljan, Luigi Piccinelli et al.CVPR 2024
