NeuroMamba: A Universal Spatiotemporal Module for Robust Perception in Degraded Sensory Streams
Jinfeng Li, Huijia Song, Xiangyue Hu, HanLiang Zhou, Jiahui Zhang, XinpengJiang, Fangli Guan, Bin Lin, DONG Dingran, Liqi Yan, Pan Li
摘要
In open-world intelligent systems, processing continuous sensory streams disrupted by heterogeneous degradation sources presents a fundamental challenge: reconciling the inherent tension between observational completeness and reconstruction fidelity. Methods that prioritize completeness by bridging long-term occlusions often introduce spurious artifacts, while approaches that focus on aggressive noise suppression inevitably disrupt temporal continuity and erase valid structures. To address this challenge, we propose NeuroMamba, a universal plug-and-play module that enhances spatiotemporal consistency in degraded streams. NeuroMamba tackles the dual objectives through two synergistic components. First, we introduce a regional Hybrid Spatiotemporal Rectification (HSR) module, which leverages Mamba-based inertial modeling of linear complexity to recover short-horizon temporal dependencies and infer missing modalities under partial observability. Second, we design a Spiking Confidence Gate (SCG) that enforces reconstruction fidelity under occupancy-guided supervision. Implemented as a hard-thresholding spiking gate unit based on leaky integrate-and-fire (LIF) neurons, SCG distinguishes valid geometric features from sensor noise based on accumulated temporal evidence. Extensive experiments on the nuScenes robustness benchmark demonstrate that NeuroMamba effectively reconciles the trade-off between completeness and fidelity, outperforming the performance of existing approaches in restoring high-fidelity spatiotemporal features from severely incomplete and degraded observations.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu 等ICCV 2021 · 被引用 31,683 次
- VMamba: Visual State Space ModelYue Liu, Yunjie Tian, Yuzhong Zhao, Hongtian Yu 等NeurIPS 2024 · 被引用 3,199 次
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelLianghui Zhu, Bencheng Liao, Qian Zhang, Xinlong Wang 等ICML 2024 · 被引用 1,725 次
- VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic PlanningBo Jiang, Shaoyu Chen, Hao Gao, Bencheng Liao 等ICLR 2026 · 被引用 259 次
相关 Paper
- Toward Time-Continuous Data Inference in Sparse Urban CrowdSensingHao Du, Wenbin Liu, Ziyu Sun, Haoyang Su 等AAAI 2026
- Toward Dynamic Non-Line-of-Sight Imaging with Mamba Enforced Temporal ConsistencyYue Li, Yi Sun, Shida Sun, Juntian Ye 等NeurIPS 2024 · 被引用 9 次
- Spatio-Temporal Interactive Learning for Efficient Image Reconstruction of Spiking CamerasBin Fan, Jiaoyang Yin, Yuchao Dai, Chao Xu 等NeurIPS 2024 · 被引用 7 次
- Height-Fidelity Dense Global Fusion for Multi-Modal 3D Object DetectionHanshi Wang, Jin Gao, Weiming Hu, Zhipeng ZhangICCV 2025 · 被引用 9 次
- HiFi-Mamba: Dual-Stream ?-Laplacian Enhanced Mamba for High-Fidelity MRI ReconstructionHongli Chen, Pengcheng Fang, Yuxia Chen, Yingxuan Ren 等AAAI 2026 · 被引用 2 次
