Leveraging Attractor Dynamics in Spatial Navigation for Better Language Parsing
Xiaolong Zou, Xingxing Cao, Xiaojiao Yang, Bo Hong
摘要
Increasing experimental evidence suggests that the human hippocampus, evolutionarily shaped by spatial navigation tasks, also plays an important role in language comprehension, indicating a shared computational mechanism for both functions. However, the specific relationship between the hippocampal formation's computational mechanism in spatial navigation and its role in language processing remains elusive. To investigate this question, we develop a prefrontal-hippocampalentorhinal model (which called PHE-trinity) that features two key aspects: 1) the use of a modular continuous attractor neural network to represent syntactic structure, akin to the grid network in the entorhinal cortex; 2) the creation of two separate input streams, mirroring the factorized structure-content representation found in the hippocampal formation. We evaluate our model on language command parsing tasks, specifically using the SCAN dataset. Our findings include: 1) attractor dynamics can facilitate systematic generalization and efficient learning from limited data; 2) through visualization and reverse engineering, we unravel a potential dynamic mechanism for grid network representing syntactic structure. Our research takes an initial step in uncovering the dynamic mechanism shared by spatial navigation and language information processing.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Hippoformer: Integrating Hippocampus-inspired Spatial Memory with TransformersTiantian Li, Xingxing Cao, Yifei Wang, Xiaojiao Yang 等ICLR 2026
- Shaping Sequence Attractor Schema in Recurrent Neural NetworksZhikun Chu, Bo Ho, Xiaolong Zou, Yuanyuan MiNeurIPS 2025
它引用的顶会 Paper3
- Relating transformers to models and neural representations of the hippocampal formationJames C. R. Whittington, Joseph Warren, Tim E. J. BehrensICLR 2022 · 被引用 110 次
- On Path Integration of Grid Cells: Group Representation and Isotropic ScalingRuiqi Gao, Jianwen Xie, Xue-Xin Wei, Song-Chun Zhu 等NeurIPS 2021 · 被引用 23 次
- Disentanglement with Biological Constraints: A Theory of Functional Cell TypesJames C. R. Whittington, Will Dorrell, Surya Ganguli, Timothy BehrensICLR 2023 · 被引用 13 次
相关 Paper
- Unfolding the Black Box of Recurrent Neural Networks for Path IntegrationTianhao Chu, Yuling Wu, Neil Burgess, Zilong Ji 等NeurIPS 2025 · 被引用 6 次
- REMI: Reconstructing Episodic Memory During Internally Driven Path PlanningZhaoze Wang, Genela Morris, Dori Derdikman, Pratik Chaudhari 等NeurIPS 2025 · 被引用 5 次
- Oscillatory Tracking of Continuous Attractor Neural Networks Account for Phase Precession and Procession of Hippocampal Place CellsTianhao Chu, Zilong Ji, Junfeng Zuo, Wenhao Zhang 等NeurIPS 2022 · 被引用 5 次
- Binding in hippocampal-entorhinal circuits enables compositionality in cognitive mapsChristopher J. Kymn, Sonia Mazelet, Anthony Thomas, Denis Kleyko 等NeurIPS 2024 · 被引用 14 次
- Not so griddy: Internal representations of RNNs path integrating more than one agentWilliam Redman, Francisco Acosta, Santiago Acosta-Mendoza, Nina MiolaneNeurIPS 2024 · 被引用 8 次
