Language (Re)modelling: Towards Embodied Language Understanding
Ronen Tamari, Chen Shani, Tom Hope, Miriam R. L. Petruck, Omri Abend, Dafna Shahaf
Abstract
While natural language understanding (NLU) is advancing rapidly, today's technology differs from human-like language understanding in fundamental ways, notably in its inferior efficiency, interpretability, and generalization. This work proposes an approach to representation and learning based on the tenets of embodied cognitive linguistics (ECL). According to ECL, natural language is inherently executable (like programming languages), driven by mental simulation and metaphoric mappings over hierarchical compositions of structures and schemata learned through embodied interaction. This position paper argues that the use of grounding by metaphoric inference and simulation will greatly benefit NLU systems, and proposes a system architecture along with a roadmap towards realizing this vision.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Breakpoint Transformers for Modeling and Tracking Intermediate BeliefsKyle Richardson, Ronen Tamari, Oren Sultan, Dafna Shahaf et al.EMNLP 2022 · 5 citations
- Will LLMs Replace the Encoder-Only Models in Temporal Relation Classification?Gabriel Roccabruna, Massimo Rizzoli, Giuseppe RiccardiEMNLP 2024 · 3 citations
- (Re)construing Meaning in NLPSean Trott, Tiago Timponi Torrent, Nancy Chang, Nathan SchneiderACL 2020 · 2 citations
Builds on3
- Measuring Compositional Generalization: A Comprehensive Method on Realistic DataDaniel Keysers, Nathanael Schärli, Nathan Scales, Hylke Buisman et al.ICLR 2020 · 401 citations
- Contrastive Learning of Structured World ModelsThomas N. Kipf, Elise van der Pol, Max WellingICLR 2020 · 322 citations
- Interactive Machine Comprehension with Information Seeking AgentsXingdi Yuan, Jie Fu, Marc-Alexandre Côté, Yi Tay et al.ACL 2020 · 11 citations
Related papers
- HISyn: human learning-inspired natural language programmingZifan Nan, Hui Guan, Xipeng ShenFSE 2020 · 12 citations
- Grammar-Based Grounded Lexicon LearningJiayuan Mao, Freda Shi, Jiajun Wu, Roger Levy et al.NeurIPS 2021 · 19 citations
- Climbing towards NLU: On Meaning, Form, and Understanding in the Age of DataEmily M. Bender, Alexander KollerACL 2020 · 914 citations
- Bootstrapping Cognitive Agents with a Large Language ModelFeiyu Zhu, Reid G. SimmonsAAAI 2024 · 14 citations
- NOSE: Neural Olfactory-Semantic Embedding with Tri-Modal Orthogonal Contrastive LearningYanyi Su, Hongshuai Wang, Zhifeng Gao, Jun ChengACL 2026
