Lune

ACL Findings2025

Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation

Qiyue Gao, Xinyu Pi, Kevin Liu, Junrong Chen, Ruolan Yang, Xinqi Huang, Xinyu Fang, Lu Sun, Gautham Kishore, Bo Ai, Stone Tao, Mengyang Liu

Abstract

Qiyue Gao, Xinyu Pi, Kevin Liu, Junrong Chen, Ruolan Yang, Xinqi Huang, Xinyu Fang, Lu Sun, Gautham Kishore, Bo Ai, Stone Tao, Mengyang Liu, Jiaxi Yang, Chao-Jung Lai, Chuanyang Jin, Jiannan Xiang, Benhao Huang, Zeming Chen, David Danks, Hao Su, Tianmin Shu, Ziqiao Ma, Lianhui Qin, Zhiting Hu. Findings of the Association for Computational Linguistics: ACL 2025. 2025.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 7 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers7

  1. ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric InteractionQineng Wang, Wenlong Huang, Yu Zhou, Hang Yin et al.ICLR 2026 · 18 citations
  2. ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal GenerationYongyuan Liang, Wei Chow, Feng Li, Ziqiao Ma et al.ICLR 2026 · 13 citations
  3. Physics in 2-Steps: Locking Motion Priors Before Visual Refinement Erases ThemWoojung Han, Seil Kang, Youngjun Jun, Min-Hung Chen et al.ICML 2026 · 2 citations
  4. Active Intelligence in Video Avatars via Closed-loop World ModelingXuanhua He, Tianyu Yang, Ke Cao, Ruiqi Wu et al.CVPR 2026 · 2 citations
  5. MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning ModelsVanya Cohen, Ray MooneyICML 2026 · 2 citations

Builds on30

  1. Dream to Control: Learning Behaviors by Latent ImaginationDanijar Hafner, Timothy P. Lillicrap, Jimmy Ba, Mohammad NorouziICLR 2020 · 1,852 citations
  2. Faith and Fate: Limits of Transformers on CompositionalityNouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li et al.NeurIPS 2023 · 728 citations
  3. CLEVRER: Collision Events for Video Representation and ReasoningKexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli et al.ICLR 2020 · 584 citations
  4. Genie: Generative Interactive EnvironmentsJake Bruce, Michael D. Dennis, Ashley Edwards, Jack Parker-Holder et al.ICML 2024 · 513 citations
  5. SpatialRGPT: Grounded Spatial Reasoning in Vision-Language ModelsAn-Chieh Cheng, Hongxu Yin, Yang Fu, Qiushan Guo et al.NeurIPS 2024 · 412 citations

Related papers

  1. Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention LoopingYao Chen, Yilong Chen, Yinqi Yang, Junyuan Shang et al.ACL Findings 2026
  2. MorphoBench: A Benchmark with Difficulty Adaptive to Model ReasoningXukai Wang, Xuanbo Liu, Mingrui Chen, Haitian Zhong et al.ACL Findings 2026
  3. Comprehensive Benchmarking of Long-Form Speech Generation in Diverse ScenariosChanghao Pan, Rui Yang, Han Wang, Zhuan Zhou et al.ACL Findings 2026
  4. AHA: Aligning Large Audio-Language Models for Reasoning Hallucinations via Counterfactual Hard NegativesYanxi Chen, Wenhui Zhu, Xiwen Chen, Zhipeng Wang et al.ACL Findings 2026
  5. Can Language Models Follow Multiple Turns of Entangled Instructions?Chi Han, Xin Liu, Haodong Wang, Shiyang Li et al.EMNLP Findings 2025
Dusk over the sea between two cliffs drawn in fine vertical lines