Lune

ACL Findings2024

Embodied Language Learning: Opportunities, Challenges, and Future Directions

Nadine Amin, Julia Rayz

Abstract

While large language and vision-language models showcase impressive capabilities, they face a notable limitation: the inability to connect language with the physical world. To bridge this gap, research has focused on embodied language learning, where the language learner is situated in the world, perceives it, and interacts with it. This article explores the current standing of research in embodied language learning, highlighting opportunities and discussing common challenges. Lastly, it identifies existing gaps from the perspective of language understanding research within the embodied world and suggests potential future directions.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Habitat 3.0: A Co-Habitat for Humans, Avatars, and Robots cites TEACh: Task-Driven Embodied Agents That Chat
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. Out of Sight, Not Out of Context? Egocentric Spatial Reasoning in VLMs Across Disjoint FramesSahithya Ravi, Gabriel Herbert Sarch, Vibhav Vineet, Andrew D. Wilson et al.EMNLP 2025 · 1 citation

Builds on22

  1. PIQA: Reasoning about Physical Commonsense in Natural LanguageYonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao et al.AAAI 2020 · 2,916 citations
  2. Climbing towards NLU: On Meaning, Form, and Understanding in the Age of DataEmily M. Bender, Alexander KollerACL 2020 · 914 citations
  3. EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of ThoughtYao Mu, Qinglong Zhang, Mengkang Hu, Wenhai Wang et al.NeurIPS 2023 · 453 citations
  4. Habitat 3.0: A Co-Habitat for Humans, Avatars, and RobotsXavier Puig, Eric Undersander, Andrew Szot, Mikael Dallaire Cote et al.ICLR 2024 · 252 citations
  5. TEACh: Task-Driven Embodied Agents That ChatAishwarya Padmakumar, Jesse Thomason, Ayush Shrivastava, Patrick Lange et al.AAAI 2022 · 251 citations

Related papers

  1. Experience Grounds LanguageYonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas et al.EMNLP 2020 · 74 citations
  2. Does Visual Grounding Enhance the Understanding of Embodied Knowledge in Large Language Models?Zhihui Yang, Yupei Wang, Kaijie Mo, Zhe Zhao et al.EMNLP Findings 2025 · 2 citations
  3. Exploring Spatial Schema Intuitions in Large Language and Vision ModelsPhilipp Wicke, Lennart WachowiakACL Findings 2024 · 7 citations
  4. VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street ViewRaphael Schumann, Wanrong Zhu, Weixi Feng, Tsu-Jui Fu et al.AAAI 2024 · 122 citations
  5. How Foundational Skills Influence VLM-based Embodied Agents: A Native PerspectiveBo Peng, Pi Bu, Keyu Pan, Xinrun Xu et al.AAAI 2026 · 1 citation
Dusk over the sea between two cliffs drawn in fine vertical lines