Ultralight Polarity-Split Neuromorphic SNN for Event-Stream Super-Resolution
Chuanzhi Xu, Haoxian Zhou, Langyi Chen, Yuk Ying Chung, Qiang Qu
摘要
Event cameras offer unparalleled advantages such as high temporal resolution, low latency, and high dynamic range. However, their limited spatial resolution poses challenges for fine-grained perception tasks. In this work, we propose an ultra-lightweight, stream-based event-to-event super-resolution method based on Spiking Neural Networks (SNNs), designed for real-time deployment on resource-constrained devices. To further reduce model size, we introduce a novel Dual-Forward Polarity-Split Event Encoding strategy that decouples positive and negative events into separate forward paths through a shared SNN. Furthermore, we propose a Learnable Spatio-temporal Polarity-aware Loss (LearnSTPLoss) that adaptively balances temporal, spatial, and polarity consistency using learnable uncertainty-based weights. Experimental results demonstrate that our method achieves competitive super-resolution performance on multiple datasets while significantly reducing model size and inference time. The lightweight design enables embedding the module into event cameras or using it as an efficient front-end preprocessing for downstream vision tasks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- End-to-End Learning of Representations for Asynchronous Event-Based DataDaniel Gehrig, Antonio Loquercio, Konstantinos G. Derpanis, Davide ScaramuzzaICCV 2019 · 被引用 427 次
- Graph-Based Object Classification for Neuromorphic Vision SensingYin Bi, Aaron Chadha, Alhabib Abbas, Eirina Bourtsoulatze 等ICCV 2019 · 被引用 195 次
- RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-ResolutionZhicheng Geng, Luming Liang, Tianyu Ding, Ilya ZharkovCVPR 2022 · 被引用 103 次
- Event Stream Super-Resolution via Spatiotemporal Constraint LearningSiqi Li, Yutong Feng, Yipeng Li, Yu Jiang 等ICCV 2021 · 被引用 25 次
- Bilateral Event Mining and Complementary for Event Stream Super-ResolutionZhilin Huang, Quanmin Liang, Yijie Yu, Chujun Qin 等CVPR 2024
相关 Paper
- Towards In-Situ Neuromorphic Computing Architecture for Event Stream Super-ResolutionYihe Yu, Bo Li, Kexin Huang, Wei Liu 等DAC 2025
- In the Blink of an Eye: Event-based Emotion RecognitionHaiwei Zhang, Jiqing Zhang, Bo Dong, Pieter Peers 等SIGGRAPH 2023 · 被引用 21 次
- Leveraging Asynchronous Spiking Neural Networks for Ultra Efficient Event-Based Visual ProcessingDingyi Zeng, Yuchen Wang, Honglin Cao, Wanlong Liu 等AAAI 2025 · 被引用 2 次
- Spiking Neural Network as Adaptive Event Stream SlicerJiahang Cao, Mingyuan Sun, Ziqing Wang, Hao Cheng 等NeurIPS 2024 · 被引用 13 次
- SpikePoint: An Efficient Point-based Spiking Neural Network for Event Cameras Action RecognitionHongwei Ren, Yue Zhou, Xiaopeng Lin, Yulong Huang 等ICLR 2024 · 被引用 39 次
