VISTREAM: Improving Computation Efficiency of Visual Streaming Perception via Law-of-Charge-Conservation Inspired Spiking Neural Network
Kang You, Ziling Wei, Jing Yan, Boning Zhang, Qinghai Guo, Yaoyu Zhang, Zhezhi He
摘要
such as autonomous driving, UAVs, and AR/VR. However, the computational efficiency of VSP on edge devices remains a challenge due to power constraints and the underutilization of temporal dependencies between frames. While spiking neural networks (SNNs) offer biologically inspired event-driven processing with potential energy benefits, their practical advantage over artificial neural networks (ANNs) for VSP tasks remains unproven. In this work, we introduce a novel framework, VISTREAM, which leverages the Law of Charge Conservation (LoCC) property in ST-BIF neurons and a differential encoding (DiffEncode) scheme to optimize SNN inference for VSP. By encoding temporal differences between neighboring frames and eliminating frequent membrane resets, VISTREAM achieves significant computational reduction while maintaining accuracy equivalent to its ANN counterpart. We provide theoretical proofs of equivalence and validate VISTREAM across diverse VSP tasks, including object detection, tracking, and segmentation, demonstrating substantial energy savings without compromising performance. VISTREAM
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Deep Residual Learning in Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Tiejun Huang 等NeurIPS 2021 · 被引用 857 次
- Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural NetworksTong Bu, Wei Fang, Jianhao Ding, Penglin Dai 等ICLR 2022 · 被引用 272 次
- T2FSNN: Deep Spiking Neural Networks with Time-to-first-spike CodingSeongsik Park, Sei Joon Kim, Byunggook Na, Sungroh YoonDAC 2020 · 被引用 121 次
- Optimized Potential Initialization for Low-Latency Spiking Neural NetworksTong Bu, Jianhao Ding, Zhaofei Yu, Tiejun HuangAAAI 2022 · 被引用 112 次
- Event-based Video Reconstruction via Potential-assisted Spiking Neural NetworkLin Zhu, Xiao Wang, Yi Chang, Jianing Li 等CVPR 2022 · 被引用 109 次
相关 Paper
- Leveraging Asynchronous Spiking Neural Networks for Ultra Efficient Event-Based Visual ProcessingDingyi Zeng, Yuchen Wang, Honglin Cao, Wanlong Liu 等AAAI 2025 · 被引用 2 次
- Event Stream Super-Resolution via Spatiotemporal Constraint LearningSiqi Li, Yutong Feng, Yipeng Li, Yu Jiang 等ICCV 2021 · 被引用 25 次
- Ultralight Polarity-Split Neuromorphic SNN for Event-Stream Super-ResolutionChuanzhi Xu, Haoxian Zhou, Langyi Chen, Yuk Ying Chung 等AAAI 2026 · 被引用 2 次
- Ev-Edge: Efficient Execution of Event-based Vision Algorithms on Commodity Edge PlatformsShrihari Sridharan, Surya Selvam, Kaushik Roy, Anand RaghunathanDAC 2024 · 被引用 3 次
- Exploring the Potentials of Spiking Neural Networks for Image DerainingShuang Chen, Tomás Krajník, Farshad Arvin, Amir Atapour-AbarghoueiAAAI 2026
