NeuroMamba: A Universal Spatiotemporal Module for Robust Perception in Degraded Sensory Streams
Jinfeng Li, Huijia Song, Xiangyue Hu, HanLiang Zhou, Jiahui Zhang, XinpengJiang, Fangli Guan, Bin Lin, DONG Dingran, Liqi Yan, Pan Li
Abstract
In open-world intelligent systems, processing continuous sensory streams disrupted by heterogeneous degradation sources presents a fundamental challenge: reconciling the inherent tension between observational completeness and reconstruction fidelity. Methods that prioritize completeness by bridging long-term occlusions often introduce spurious artifacts, while approaches that focus on aggressive noise suppression inevitably disrupt temporal continuity and erase valid structures. To address this challenge, we propose NeuroMamba, a universal plug-and-play module that enhances spatiotemporal consistency in degraded streams. NeuroMamba tackles the dual objectives through two synergistic components. First, we introduce a regional Hybrid Spatiotemporal Rectification (HSR) module, which leverages Mamba-based inertial modeling of linear complexity to recover short-horizon temporal dependencies and infer missing modalities under partial observability. Second, we design a Spiking Confidence Gate (SCG) that enforces reconstruction fidelity under occupancy-guided supervision. Implemented as a hard-thresholding spiking gate unit based on leaky integrate-and-fire (LIF) neurons, SCG distinguishes valid geometric features from sensor noise based on accumulated temporal evidence. Extensive experiments on the nuScenes robustness benchmark demonstrate that NeuroMamba effectively reconciles the trade-off between completeness and fidelity, outperforming the performance of existing approaches in restoring high-fidelity spatiotemporal features from severely incomplete and degraded observations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on13
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- VMamba: Visual State Space ModelYue Liu, Yunjie Tian, Yuzhong Zhao, Hongtian Yu et al.NeurIPS 2024 · 3,199 citations
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelLianghui Zhu, Bencheng Liao, Qian Zhang, Xinlong Wang et al.ICML 2024 · 1,725 citations
- VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic PlanningBo Jiang, Shaoyu Chen, Hao Gao, Bencheng Liao et al.ICLR 2026 · 259 citations
Related papers
- Toward Time-Continuous Data Inference in Sparse Urban CrowdSensingHao Du, Wenbin Liu, Ziyu Sun, Haoyang Su et al.AAAI 2026
- Toward Dynamic Non-Line-of-Sight Imaging with Mamba Enforced Temporal ConsistencyYue Li, Yi Sun, Shida Sun, Juntian Ye et al.NeurIPS 2024 · 9 citations
- Spatio-Temporal Interactive Learning for Efficient Image Reconstruction of Spiking CamerasBin Fan, Jiaoyang Yin, Yuchao Dai, Chao Xu et al.NeurIPS 2024 · 7 citations
- Height-Fidelity Dense Global Fusion for Multi-Modal 3D Object DetectionHanshi Wang, Jin Gao, Weiming Hu, Zhipeng ZhangICCV 2025 · 9 citations
- HiFi-Mamba: Dual-Stream ?-Laplacian Enhanced Mamba for High-Fidelity MRI ReconstructionHongli Chen, Pengcheng Fang, Yuxia Chen, Yingxuan Ren et al.AAAI 2026 · 2 citations
