RMFAT: Recurrent Multi-scale Feature Atmospheric Turbulence Mitigator
Zhiming Liu, Nantheera Anantrasirichai
摘要
Atmospheric turbulence severely degrades video quality by introducing distortions such as geometric warping, blur, and temporal flickering, posing significant challenges to both visual clarity and temporal consistency. Current state-of-the-art methods are based on transformer, 3D architectures and require multi-frame input, but their large computational cost and memory usage limit real-time deployment, especially in resource-constrained scenarios. In this work, we propose RMFAT -Recurrent Multi-scale Feature Atmospheric Turbulence Mitigator designed for efficient and temporally consistent video restoration under AT conditions. RMFAT adopts a lightweight recurrent framework that restores each frame using only two inputs at a time, significantly reducing temporal window size and computational burden. It further integrates multi-scale feature encoding and decoding with temporal warping modules at both encoder and decoder stages to enhance spatial detail and temporal coherence. Extensive experiments conducted on synthetic and real-world atmospheric turbulence datasets demonstrate that RMFAT not only outperforms existing methods in terms of clarity restoration (with nearly a 9% improvement in SSIM) but also achieves significantly improved inference speed (achieving a more than fourfold reduction), making it particularly suitable for realtime atmospheric turbulence suppression tasks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and AlignmentKelvin C. K. Chan, Shangchen Zhou, Xiangyu Xu, Chen Change LoyCVPR 2022 · 被引用 522 次
- Accelerating Atmospheric Turbulence Simulation via Learned Phase-to-Space TransformZhiyuan Mao, Nicholas Chimitt, Stanley H. ChanICCV 2021 · 被引用 83 次
- Physics-Driven Turbulence Image Restoration with Stochastic RefinementAjay Jaiswal, Xingguang Zhang, Stanley H. Chan, Zhangyang WangICCV 2023 · 被引用 38 次
- Turb-Seg-Res: A Segment-then-Restore Pipeline for Dynamic Videos with Atmospheric TurbulenceRipon Kumar Saha, Dehao Qin, Nianyi Li, Jinwei Ye 等CVPR 2024 · 被引用 7 次
- Learning Phase Distortion with Selective State Space Models for Video Turbulence MitigationXingguang Zhang, Nicholas Chimitt, Xijun Wang, Yu Yuan 等CVPR 2025
相关 Paper
- Temporally Consistent Atmospheric Turbulence Mitigation with Neural RepresentationsHaoming Cai, Jingxi Chen, Brandon Y. Feng, Weiyun Jiang 等NeurIPS 2024 · 被引用 7 次
- Spatio-Temporal Turbulence Mitigation: A Translational PerspectiveXingguang Zhang, Nicholas Chimitt, Yiheng Chi, Zhiyuan Mao 等CVPR 2024 · 被引用 17 次
- Recurrent Video Restoration Transformer with Guided Deformable AttentionJingyun Liang, Yuchen Fan, Xiaoyu Xiang, Rakesh Ranjan 等NeurIPS 2022 · 被引用 318 次
- Physically-Grounded Turbulence Mitigation with Frame-Shared Degradation ParametersDongxin Xie, Yan Huang, Yong Xu, Hui JiCVPR 2026
- HATIR: Heat-Aware Diffusion for Turbulent Infrared Video Super-ResolutionYang Zou, Xingyue Zhu, Kaiqi Han, Jun Ma 等AAAI 2026 · 被引用 3 次
