Graph-based Asynchronous Event Processing for Rapid Object Recognition
Yijin Li, Han Zhou, Bangbang Yang, Ye Zhang, Zhaopeng Cui, Hujun Bao, Guofeng Zhang
Abstract
Different from traditional video cameras, event cameras capture asynchronous events stream in which each event encodes pixel location, trigger time, and the polarity of the brightness changes. In this paper, we introduce a novel graph-based framework for event cameras, namely SlideGCN. Unlike some recent graph-based methods that use groups of events as input, our approach can efficiently process data event-by-event, unlock the low latency nature of events data while still maintaining the graph's structure internally. For fast graph construction, we develop a radius search algorithm, which better exploits the partial regular structure of event cloud against k-d tree based generic methods. Experiments show that our method reduces the computational complexity up to 100 times with respect to current graph-based methods while keeping state-of-the-art performance on object recognition. Moreover, we verify the superiority of event-wise processing with our method. When the state becomes stable, we can give a prediction with high confidence, thus making an early recognition. Project page: https://zju3dv.github.io/slide_gcn/ .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5d5fc30f-cc61-4c04-8ffb-99ee4bb5fa70Cited by top-tier papers25
- AEGNN: Asynchronous Event-based Graph Neural NetworksSimon Schaefer, Daniel Gehrig, Davide ScaramuzzaCVPR 2022 · 135 citations
- GET: Group Event Transformer for Event-Based VisionYansong Peng, Yueyi Zhang, Zhiwei Xiong, Xiaoyan Sun et al.ICCV 2023 · 86 citations
- From Chaos Comes Order: Ordering Event Representations for Object Recognition and DetectionNikola Zubic, Daniel Gehrig, Mathias Gehrig, Davide ScaramuzzaICCV 2023 · 71 citations
- Scene Adaptive Sparse Transformer for Event-based Object DetectionYansong Peng, Hebei Li, Yueyi Zhang, Xiaoyan Sun et al.CVPR 2024 · 25 citations
- E2PNet: Event to Point Cloud Registration with Spatio-Temporal Representation LearningXiuhong Lin, Changjie Qiu, Zhipeng Cai, Siqi Shen et al.NeurIPS 2023 · 18 citations
Builds on4
- End-to-End Learning of Representations for Asynchronous Event-Based DataDaniel Gehrig, Antonio Loquercio, Konstantinos G. Derpanis, Davide ScaramuzzaICCV 2019 · 427 citations
- Learning an Event Sequence Embedding for Dense Event-Based Deep StereoStepan Tulyakov, François Fleuret, Martin Kiefel, Peter V. Gehler et al.ICCV 2019 · 122 citations
- Effective AER Object Classification Using Segmented Probability-Maximization Learning in Spiking Neural NetworksQianhui Liu, Haibo Ruan, Dong Xing, Huajin Tang et al.AAAI 2020 · 66 citations
- Learning Visual Motion Segmentation Using Event SurfacesAnton Mitrokhin, Zhiyuan Hua, Cornelia Fermüller, Yiannis AloimonosCVPR 2020
Related papers
- Asynchronous Event Processing with Local-Shift Graph Convolutional NetworkLinhui Sun, Yifan Zhang, Jian Cheng, Hanqing LuAAAI 2023 · 2 citations
- Leveraging Asynchronous Spiking Neural Networks for Ultra Efficient Event-Based Visual ProcessingDingyi Zeng, Yuchen Wang, Honglin Cao, Wanlong Liu et al.AAAI 2025 · 2 citations
- A Voxel Graph CNN for Object Classification with Event CamerasYongjian Deng, Hao Chen, Hai Liu, Youfu LiCVPR 2022 · 55 citations
- Graph Neural Network Combining Event Stream and Periodic Aggregation for Low-Latency Event-based VisionManon Dampfhoffer, Thomas Mesquida, Damien Joubert, Thomas Dalgaty et al.CVPR 2025
- Dual Memory Aggregation Network for Event-Based Object Detection with Learnable RepresentationDongsheng Wang, Xu Jia, Yang Zhang, Xinyu Zhang et al.AAAI 2023 · 22 citations
