High-Quality and Efficient Turbulence Mitigation with Events
Xiaoran Zhang, Jian Ding, Yuxing Duan, Haoyue Liu, Gang Chen, Yi Chang, Luxin Yan
Abstract
Turbulence mitigation (TM) is highly ill-posed due to the stochastic nature of atmospheric turbulence. Most methods rely on multiple frames recorded by conventional cameras to capture stable patterns in natural scenarios. However, they inevitably suffer from a trade-off between accuracy and efficiency: more frames enhance restoration at the cost of higher system latency and larger data overhead. Event cameras, equipped with microsecond temporal resolution and efficient sensing of dynamic changes, offer an opportunity to break the bottleneck. In this work, we present EHETM, a high-quality and efficient TM method inspired by the superiority of events to model motions in continuous sequences. We discover two key phenomena: (1) turbulence-induced events exhibit distinct polarity alternation correlated with sharp image gradients, providing structural cues for restoring scenes; and (2) dynamic objects form spatiotemporally coherent ``event tubes''in contrast to irregular patterns within turbulent events, providing motion priors for disentangling objects from turbulence. Based on these insights, we design two complementary modules that respectively leverage polarity-weighted gradients for scene refinement and event-tube constraints for motion decoupling, achieving high-quality restoration with few frames. Furthermore, we construct two real-world event-frame turbulence datasets covering atmospheric and thermal cases. Experiments show that EHETM outperforms SOTA methods, especially under scenes with dynamic objects, while reducing data overhead and system latency by approximately 77.3% and 89.5%, respectively. Our code is available at: https://github.com/Xavier667/EHETM.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a2e49c0e-998f-494c-840b-513355ea3680Builds on23
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelLianghui Zhu, Bencheng Liao, Qian Zhang, Xinlong Wang et al.ICML 2024 · 1,725 citations
- RainMamba: Enhanced Locality Learning with State Space Models for Video DerainingHongtao Wu, Yijun Yang, Huihui Xu, Weiming Wang et al.ACM MM 2024 · 51 citations
- Physics-Driven Turbulence Image Restoration with Stochastic RefinementAjay Jaiswal, Xingguang Zhang, Stanley H. Chan, Zhangyang WangICCV 2023 · 38 citations
- Unsupervised Non-Rigid Image Distortion Removal via Grid DeformationNianyi Li, Simron Thapa, Cameron Whyte, Albert W. Reed et al.ICCV 2021 · 38 citations
- Generalizing Event-Based Motion Deblurring in Real-World ScenariosXiang Zhang, Lei Yu, Wen Yang, Jianzhuang Liu et al.ICCV 2023 · 35 citations
Related papers
- Separation for Better Integration: Disentangling Edge and Motion in Event-Based DeblurringYufei Zhu, Hao Chen, Yongjian Deng, Wei YouICCV 2025 · 1 citation
- EvIntSR-Net: Event Guided Multiple Latent Frames Reconstruction and Super-resolutionJin Han, Yixin Yang, Chu Zhou, Chao Xu et al.ICCV 2021 · 57 citations
- Latency Correction for Event-Guided Deblurring and Frame InterpolationYixin Yang, Jinxiu Liang, Bohan Yu, Yan Chen et al.CVPR 2024 · 11 citations
- Event-Intensity Stereo: Estimating Depth by the Best of Both WorldsS. Mohammad Mostafavi I., Kuk-Jin Yoon, Jonghyun ChoiICCV 2021 · 45 citations
- E2HQV: High-Quality Video Generation from Event Camera via Theory-Inspired Model-Aided Deep LearningQiang Qu, Yiran Shen, Xiaoming Chen, Yuk Ying Chung et al.AAAI 2024 · 19 citations
