Localist Topographic Expert Routing: A Barrel Cortex-Inspired Modular Network for Sensorimotor Processing
Tianfang Zhu, Dongli Hu, Jiandong Zhou, Kai Du, Anan Li
摘要
Biological sensorimotor systems process information through spatially organized, functionally specialized modules. A canonical example is the rodent barrel cortex, in which each vibrissa (whisker) projects to a dedicated cortical column, forming a precise somatotopic map. This anatomical organization stands in stark contrast to the architectures of most artificial neural networks, which are typically monolithic or rely on expert-isolated mixture-of-experts (MoE) mechanisms. In this work, we introduce a brain-inspired modular architecture that treats the barrel cortex as a biologically constrained instantiation of an expert system. Each module (or “expert”) corresponds to a cortical column composed of multiple neuron subtypes spanning vertical cortical layers. Sensory signals are routed exclusively to their corresponding columns, with inter-column communication restricted to local neighbors via a sparse gating mechanism. Despite these anatomical constraints, our model achieves competitive, state-of-the-art performance on challenging 3D tactile object classification benchmarks. Columnar parameter sharing provides inherent regularization, enabling 97% parameter reduction with improved training stability. Notably, constrained localist routing suppresses inter-module activity correlations, mirroring the barrel cortex’s lateral inhibition for sensory differentiation, while suggesting MoE’s potential to reduce expert redundancy through collaborative constraints. These results suggest how cortical principles of localist expert routing and topographic organization could potentially be translated into machine learning architectures. Code is available at https://github.com/fun0515/MultiBarrelModel .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language ModelsDamai Dai, Chengqi Deng, Chenggang Zhao, R. X. Xu 等ACL 2024 · 被引用 171 次
- Chain-of-Experts: When LLMs Meet Complex Operations Research ProblemsZiyang Xiao, Dongxiang Zhang, Yangjun Wu, Lilin Xu 等ICLR 2024 · 被引用 136 次
- Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable SpacingsIlyass Hammouamri, Ismail Khalfaoui Hassani, Timothée MasquelierICLR 2024 · 被引用 105 次
- OLMoE: Open Mixture-of-Experts Language ModelsNiklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Kyle Lo 等ICLR 2025
相关 Paper
- Biologically Constrained Barrel Cortex Model Integrates Whisker Inputs and Replicates Key Brain Network DynamicsTianfang Zhu, Dongli Hu, Jiandong Zhou, Kai Du 等ICLR 2025
- Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent BrainTrinity Chung, Yuchen Shen, Nathan C. L. Kong, Aran NayebiNeurIPS 2025 · 被引用 1 次
- Towards Understanding the Mixture-of-Experts Layer in Deep LearningZixiang Chen, Yihe Deng, Yue Wu, Quanquan Gu 等NeurIPS 2022 · 被引用 199 次
- Multilinear Mixture of Experts: Scalable Expert Specialization through FactorizationJames Oldfield, Markos Georgopoulos, Grigorios Chrysos, Christos Tzelepis 等NeurIPS 2024 · 被引用 41 次
- GMoE: Global Mixture of Experts with Logit PropagationGeonwoo Hong, Taehwan KimACL 2026
