High-Quality and Efficient Turbulence Mitigation with Events
Xiaoran Zhang, Jian Ding, Yuxing Duan, Haoyue Liu, Gang Chen, Yi Chang, Luxin Yan
摘要
Turbulence mitigation (TM) is highly ill-posed due to the stochastic nature of atmospheric turbulence. Most methods rely on multiple frames recorded by conventional cameras to capture stable patterns in natural scenarios. However, they inevitably suffer from a trade-off between accuracy and efficiency: more frames enhance restoration at the cost of higher system latency and larger data overhead. Event cameras, equipped with microsecond temporal resolution and efficient sensing of dynamic changes, offer an opportunity to break the bottleneck. In this work, we present EHETM, a high-quality and efficient TM method inspired by the superiority of events to model motions in continuous sequences. We discover two key phenomena: (1) turbulence-induced events exhibit distinct polarity alternation correlated with sharp image gradients, providing structural cues for restoring scenes; and (2) dynamic objects form spatiotemporally coherent ``event tubes''in contrast to irregular patterns within turbulent events, providing motion priors for disentangling objects from turbulence. Based on these insights, we design two complementary modules that respectively leverage polarity-weighted gradients for scene refinement and event-tube constraints for motion decoupling, achieving high-quality restoration with few frames. Furthermore, we construct two real-world event-frame turbulence datasets covering atmospheric and thermal cases. Experiments show that EHETM outperforms SOTA methods, especially under scenes with dynamic objects, while reducing data overhead and system latency by approximately 77.3% and 89.5%, respectively. Our code is available at: https://github.com/Xavier667/EHETM.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper23
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelLianghui Zhu, Bencheng Liao, Qian Zhang, Xinlong Wang 等ICML 2024 · 被引用 1,725 次
- RainMamba: Enhanced Locality Learning with State Space Models for Video DerainingHongtao Wu, Yijun Yang, Huihui Xu, Weiming Wang 等ACM MM 2024 · 被引用 51 次
- Physics-Driven Turbulence Image Restoration with Stochastic RefinementAjay Jaiswal, Xingguang Zhang, Stanley H. Chan, Zhangyang WangICCV 2023 · 被引用 38 次
- Unsupervised Non-Rigid Image Distortion Removal via Grid DeformationNianyi Li, Simron Thapa, Cameron Whyte, Albert W. Reed 等ICCV 2021 · 被引用 38 次
- Generalizing Event-Based Motion Deblurring in Real-World ScenariosXiang Zhang, Lei Yu, Wen Yang, Jianzhuang Liu 等ICCV 2023 · 被引用 35 次
相关 Paper
- Separation for Better Integration: Disentangling Edge and Motion in Event-Based DeblurringYufei Zhu, Hao Chen, Yongjian Deng, Wei YouICCV 2025 · 被引用 1 次
- EvIntSR-Net: Event Guided Multiple Latent Frames Reconstruction and Super-resolutionJin Han, Yixin Yang, Chu Zhou, Chao Xu 等ICCV 2021 · 被引用 57 次
- Latency Correction for Event-Guided Deblurring and Frame InterpolationYixin Yang, Jinxiu Liang, Bohan Yu, Yan Chen 等CVPR 2024 · 被引用 11 次
- Event-Intensity Stereo: Estimating Depth by the Best of Both WorldsS. Mohammad Mostafavi I., Kuk-Jin Yoon, Jonghyun ChoiICCV 2021 · 被引用 45 次
- E2HQV: High-Quality Video Generation from Event Camera via Theory-Inspired Model-Aided Deep LearningQiang Qu, Yiran Shen, Xiaoming Chen, Yuk Ying Chung 等AAAI 2024 · 被引用 19 次
