Ultralight Polarity-Split Neuromorphic SNN for Event-Stream Super-Resolution
Chuanzhi Xu, Haoxian Zhou, Langyi Chen, Yuk Ying Chung, Qiang Qu
Abstract
Event cameras offer unparalleled advantages such as high temporal resolution, low latency, and high dynamic range. However, their limited spatial resolution poses challenges for fine-grained perception tasks. In this work, we propose an ultra-lightweight, stream-based event-to-event super-resolution method based on Spiking Neural Networks (SNNs), designed for real-time deployment on resource-constrained devices. To further reduce model size, we introduce a novel Dual-Forward Polarity-Split Event Encoding strategy that decouples positive and negative events into separate forward paths through a shared SNN. Furthermore, we propose a Learnable Spatio-temporal Polarity-aware Loss (LearnSTPLoss) that adaptively balances temporal, spatial, and polarity consistency using learnable uncertainty-based weights. Experimental results demonstrate that our method achieves competitive super-resolution performance on multiple datasets while significantly reducing model size and inference time. The lightweight design enables embedding the module into event cameras or using it as an efficient front-end preprocessing for downstream vision tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0ca79832-65e6-413a-a3fc-208b14dd8beaBuilds on7
- End-to-End Learning of Representations for Asynchronous Event-Based DataDaniel Gehrig, Antonio Loquercio, Konstantinos G. Derpanis, Davide ScaramuzzaICCV 2019 · 427 citations
- Graph-Based Object Classification for Neuromorphic Vision SensingYin Bi, Aaron Chadha, Alhabib Abbas, Eirina Bourtsoulatze et al.ICCV 2019 · 195 citations
- RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-ResolutionZhicheng Geng, Luming Liang, Tianyu Ding, Ilya ZharkovCVPR 2022 · 103 citations
- Event Stream Super-Resolution via Spatiotemporal Constraint LearningSiqi Li, Yutong Feng, Yipeng Li, Yu Jiang et al.ICCV 2021 · 25 citations
- Bilateral Event Mining and Complementary for Event Stream Super-ResolutionZhilin Huang, Quanmin Liang, Yijie Yu, Chujun Qin et al.CVPR 2024
Related papers
- Towards In-Situ Neuromorphic Computing Architecture for Event Stream Super-ResolutionYihe Yu, Bo Li, Kexin Huang, Wei Liu et al.DAC 2025
- In the Blink of an Eye: Event-based Emotion RecognitionHaiwei Zhang, Jiqing Zhang, Bo Dong, Pieter Peers et al.SIGGRAPH 2023 · 21 citations
- Leveraging Asynchronous Spiking Neural Networks for Ultra Efficient Event-Based Visual ProcessingDingyi Zeng, Yuchen Wang, Honglin Cao, Wanlong Liu et al.AAAI 2025 · 2 citations
- Spiking Neural Network as Adaptive Event Stream SlicerJiahang Cao, Mingyuan Sun, Ziqing Wang, Hao Cheng et al.NeurIPS 2024 · 13 citations
- SpikePoint: An Efficient Point-based Spiking Neural Network for Event Cameras Action RecognitionHongwei Ren, Yue Zhou, Xiaopeng Lin, Yulong Huang et al.ICLR 2024 · 39 citations
