Structure Abstraction and Generalization in a Hippocampal-Entorhinal Inspired World Model
Tianqiu Zhang, Muyang Lyu, Xiao Liu, Si Wu
Abstract
Humans abstract experiences into structured representations to facilitate pattern inference and knowledge transfer. While the hippocampalentorhinal (HPC-MEC) circuit is known to represent both spatial and conceptual spaces, the mechanisms for concurrently extracting abstract structures from continuous, high-dimensional dynamics remain poorly understood. We propose a brain-inspired hierarchical model that simultaneously infers latent transitions and constructs a predictive visual world model. Our architecture employs an inverse model for structural extraction alongside an HPC-MEC coupling model that dissociates relational structures (MEC) from integrated episodic scenes (HPC). Using primitive transformation dynamics as a benchmark, we demonstrate the model's capacity for structural abstraction. By leveraging velocity-driven path integration, the framework enables robust prediction and structural reuse across diverse contexts, thereby achieving structural generalization. This work provides a novel computational framework for understanding how brain-inspired, selfsupervised learning of world models facilitates the acquisition of reusable abstract knowledge.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a9913871-a4b4-4be4-9855-970d87fa2d13Builds on8
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised LearningAdrien Bardes, Jean Ponce, Yann LeCunICLR 2022 · 1,226 citations
- Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale PredictionKeyu Tian, Yi Jiang, Zehuan Yuan, Bingyue Peng et al.NeurIPS 2024 · 1,199 citations
- Learning to Act without ActionsDominik Schmidt, Minqi JiangICLR 2024 · 98 citations
- Flexible mapping of abstract domains by grid cells via self-supervised extraction and projection of generalized velocity signalsAbhiram Iyer, Sarthak Chandra, Sugandha Sharma, Ila FieteNeurIPS 2024 · 4 citations
Related papers
- A Cognitive Model for Learning Abstract Relational Structures from Memory-based Decision-Making TasksHaruo HosoyaICLR 2024 · 1 citation
- Variational Predictive Routing with Nested Subjective TimescalesAlexey Zakharov, Qinghai Guo, Zafeirios FountasICLR 2022 · 12 citations
- Revisiting Hierarchical Approach for Persistent Long-Term Video PredictionWonkwang Lee, Whie Jung, Han Zhang, Ting Chen et al.ICLR 2021 · 29 citations
- Learning abstract structure for drawing by efficient motor program inductionLucas Yanan Tian, Kevin Ellis, Marta Kryven, Josh TenenbaumNeurIPS 2020 · 47 citations
- DiLA: Disentangled Latent Action World ModelsTianqiu Zhang, Muyang Lyu, Yufan Zhang, Fang Fang et al.ICML 2026 · 2 citations
