Spike-driven Discrete Aggregation for Event-based Object Detection
Huaning Li, Ziming Wang, Runhao Jiang, Yan Rui, Huajin Tang
摘要
With their high dynamic range and temporal resolution, event cameras are well-suited for object detection, especially under motion blur and extreme illumination. Recent state-of-the-art works for event-based object detection primarily focus on the high-level design of backbones. However, developing effective event representations is equally crucial, as it bridges asynchronous event streams with the dense tensors required by detection networks. Most existing aggregation strategies for event representation continuously accumulate all events within sampled intervals without selective filtering, inevitably introducing uninformative events that degrade detection accuracy. To address this limitation, we introduce a novel perspective, termed Discrete Aggregation, which adaptively and discretely selects informative events for differentiable aggregation. We realize this through the Spiking Discrete Aggregation (SDA) module, which is inspired by the threshold-based spike firing mechanism in Spiking Neural Networks (SNNs) and implemented using gated recurrent spiking neurons. Additionally, we introduce the Multi-Timescale Fusion (MTF) method which leverages coarse-grained temporal features from continuous event streams to further enhance the representation capability of SDA. Experimental results on neuromorphic datasets demonstrate that our method achieves state-of-theart performance among all fully spiking architectures while using fewer parameters, reaching 43.4% mAP 50:95 on Gen1 (+ 4.5% over prior art). Moreover, our method exhibits superior robustness under noisy conditions and shows strong compatibility with non-spiking models.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without ConvolutionsWenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan 等ICCV 2021 · 被引用 4,909 次
- Learning to Detect Objects with a 1 Megapixel Event CameraEtienne Perot, Pierre de Tournemire, Davide Nitti, Jonathan Masci 等NeurIPS 2020 · 被引用 381 次
- Temporal-wise Attention Spiking Neural Networks for Event Streams ClassificationMan Yao, Huanhuan Gao, Guangshe Zhao, Dingheng Wang 等ICCV 2021 · 被引用 225 次
- Deep Directly-Trained Spiking Neural Networks for Object DetectionQiaoyi Su, Yuhong Chou, Yifan Hu, Jianing Li 等ICCV 2023 · 被引用 143 次
- AEGNN: Asynchronous Event-based Graph Neural NetworksSimon Schaefer, Daniel Gehrig, Davide ScaramuzzaCVPR 2022 · 被引用 135 次
相关 Paper
- SFOD: Spiking Fusion Object DetectorYimeng Fan, Wei Zhang, Changsong Liu, Mingyang Li 等CVPR 2024
- Efficient Event-Based Object Detection: A Hybrid Neural Network with Spatial and Temporal AttentionSoikat Hasan Ahmed, Jan Finkbeiner, Emre NeftciCVPR 2025
- Effective AER Object Classification Using Segmented Probability-Maximization Learning in Spiking Neural NetworksQianhui Liu, Haibo Ruan, Dong Xing, Huajin Tang 等AAAI 2020 · 被引用 66 次
- SDTrack: A Baseline for Event-based Tracking via Spiking Neural NetworksYimeng Shan, Zhenbang Ren, Haodi Wu, Wenjie Wei 等CVPR 2026 · 被引用 14 次
- Event Stream Super-Resolution via Spatiotemporal Constraint LearningSiqi Li, Yutong Feng, Yipeng Li, Yu Jiang 等ICCV 2021 · 被引用 25 次
