A Chaotic Dynamics Framework Inspired by Dorsal Stream for Event Signal Processing
Yu Chen, Jing Lian, Zhaofei Yu, Jizhao Liu, Jisheng Dang, Gang Wang
Abstract
Event cameras are bio-inspired vision sensors that encode visual information with high dynamic range, high temporal resolution, and low latency. Current state-of-the-art event stream processing methods rely on end-to-end deep learning techniques. However, these models are heavily dependent on data structures, limiting their stability and generalization capabilities across tasks, thereby hindering their deployment in real-world scenarios. To address this issue, we propose a chaotic dynamics event signal processing framework inspired by the dorsal visual pathway of the brain. Specifically, we utilize Continuouscoupled Neural Network (CCNN) to encode the event stream. CCNN encodes polarity-invariant event sequences as periodic signals and polaritychanging event sequences as chaotic signals. We then use continuous wavelet transforms to analyze the dynamical states of CCNN neurons and establish the high-order mappings of the event stream. The effectiveness of our method is validated through integration with conventional classification networks, achieving state-of-the-art classification accuracy on the N-Caltech101 and N-CARS datasets, with results of 84.3% and 99.9%, respectively. Our method improves the accuracy of event camera-based object classification while significantly enhancing the generalization and stability of event representation. Our code is available in https://github.com/chenyu0193/ACDF.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on7
- Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural NetworksWei Fang, Zhaofei Yu, Yanqi Chen, Timothée Masquelier et al.ICCV 2021 · 731 citations
- End-to-End Learning of Representations for Asynchronous Event-Based DataDaniel Gehrig, Antonio Loquercio, Konstantinos G. Derpanis, Davide ScaramuzzaICCV 2019 · 427 citations
- Graph-Based Object Classification for Neuromorphic Vision SensingYin Bi, Aaron Chadha, Alhabib Abbas, Eirina Bourtsoulatze et al.ICCV 2019 · 195 citations
- Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural NetworksJesse J. Hagenaars, Federico Paredes-Vallés, Guido de CroonNeurIPS 2021 · 178 citations
- AEGNN: Asynchronous Event-based Graph Neural NetworksSimon Schaefer, Daniel Gehrig, Davide ScaramuzzaCVPR 2022 · 135 citations
Related papers
- E2HQV: High-Quality Video Generation from Event Camera via Theory-Inspired Model-Aided Deep LearningQiang Qu, Yiran Shen, Xiaoming Chen, Yuk Ying Chung et al.AAAI 2024 · 19 citations
- Event Stream Super-Resolution via Spatiotemporal Constraint LearningSiqi Li, Yutong Feng, Yipeng Li, Yu Jiang et al.ICCV 2021 · 25 citations
- Dual Memory Aggregation Network for Event-Based Object Detection with Learnable RepresentationDongsheng Wang, Xu Jia, Yang Zhang, Xinyu Zhang et al.AAAI 2023 · 22 citations
- Leveraging Asynchronous Spiking Neural Networks for Ultra Efficient Event-Based Visual ProcessingDingyi Zeng, Yuchen Wang, Honglin Cao, Wanlong Liu et al.AAAI 2025 · 2 citations
- Rethinking Scale-Aware Temporal Encoding for Event-based Object DetectionLin Zhu, Tengyu Long, Xiao Wang, Lizhi Wang et al.NeurIPS 2025 · 4 citations
