Leveraging Attractor Dynamics in Spatial Navigation for Better Language Parsing
Xiaolong Zou, Xingxing Cao, Xiaojiao Yang, Bo Hong
Abstract
Increasing experimental evidence suggests that the human hippocampus, evolutionarily shaped by spatial navigation tasks, also plays an important role in language comprehension, indicating a shared computational mechanism for both functions. However, the specific relationship between the hippocampal formation's computational mechanism in spatial navigation and its role in language processing remains elusive. To investigate this question, we develop a prefrontal-hippocampalentorhinal model (which called PHE-trinity) that features two key aspects: 1) the use of a modular continuous attractor neural network to represent syntactic structure, akin to the grid network in the entorhinal cortex; 2) the creation of two separate input streams, mirroring the factorized structure-content representation found in the hippocampal formation. We evaluate our model on language command parsing tasks, specifically using the SCAN dataset. Our findings include: 1) attractor dynamics can facilitate systematic generalization and efficient learning from limited data; 2) through visualization and reverse engineering, we unravel a potential dynamic mechanism for grid network representing syntactic structure. Our research takes an initial step in uncovering the dynamic mechanism shared by spatial navigation and language information processing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bde29292-cbc5-47f8-b680-c296f4ab3249Cited by top-tier papers2
- Hippoformer: Integrating Hippocampus-inspired Spatial Memory with TransformersTiantian Li, Xingxing Cao, Yifei Wang, Xiaojiao Yang et al.ICLR 2026
- Shaping Sequence Attractor Schema in Recurrent Neural NetworksZhikun Chu, Bo Ho, Xiaolong Zou, Yuanyuan MiNeurIPS 2025
Builds on3
- Relating transformers to models and neural representations of the hippocampal formationJames C. R. Whittington, Joseph Warren, Tim E. J. BehrensICLR 2022 · 110 citations
- On Path Integration of Grid Cells: Group Representation and Isotropic ScalingRuiqi Gao, Jianwen Xie, Xue-Xin Wei, Song-Chun Zhu et al.NeurIPS 2021 · 23 citations
- Disentanglement with Biological Constraints: A Theory of Functional Cell TypesJames C. R. Whittington, Will Dorrell, Surya Ganguli, Timothy BehrensICLR 2023 · 13 citations
Related papers
- Unfolding the Black Box of Recurrent Neural Networks for Path IntegrationTianhao Chu, Yuling Wu, Neil Burgess, Zilong Ji et al.NeurIPS 2025 · 6 citations
- REMI: Reconstructing Episodic Memory During Internally Driven Path PlanningZhaoze Wang, Genela Morris, Dori Derdikman, Pratik Chaudhari et al.NeurIPS 2025 · 5 citations
- Oscillatory Tracking of Continuous Attractor Neural Networks Account for Phase Precession and Procession of Hippocampal Place CellsTianhao Chu, Zilong Ji, Junfeng Zuo, Wenhao Zhang et al.NeurIPS 2022 · 5 citations
- Binding in hippocampal-entorhinal circuits enables compositionality in cognitive mapsChristopher J. Kymn, Sonia Mazelet, Anthony Thomas, Denis Kleyko et al.NeurIPS 2024 · 14 citations
- Not so griddy: Internal representations of RNNs path integrating more than one agentWilliam Redman, Francisco Acosta, Santiago Acosta-Mendoza, Nina MiolaneNeurIPS 2024 · 8 citations
