Keep it SymPL: Symbolic Projective Layout for Allocentric Spatial Reasoning in Vision-Language Models
Jaeyun Jang, Seunghui Shin, Taeho Park, Hyoseok Hwang
摘要
Perspective-aware spatial reasoning involves understanding spatial relationships from specific viewpoints—either egocentric (observer-centered) or allocentric (object-centered).While vision–language models (VLMs) perform well in egocentric settings, their performance deteriorates when reasoning from allocentric viewpoints, where spatial relations must be inferred from the perspective of objects within the scene.In this study, we address this underexplored challenge by introducing bolic rojective ayout (SymPL), a framework that reformulates allocentric reasoning into symbolic-layout forms that VLMs inherently handle well.By leveraging four key factors—projection, abstraction, bipartition, and localization—SymPL converts allocentric questions into structured symbolic-layout representations.Extensive experiments demonstrate that this reformulation substantially improves performance in both allocentric and egocentric tasks, enhances robustness under visual illusions and multi-view scenarios, and that each component contributes critically to these gains.These results show that SymPL provides an effective and principled approach for addressing complex perspective-aware spatial reasoning.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper27
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsPeter Tong, Ellis Brown, Penghao Wu, Sanghyun Woo 等NeurIPS 2024 · 被引用 1,004 次
- SpatialRGPT: Grounded Spatial Reasoning in Vision-Language ModelsAn-Chieh Cheng, Hongxu Yin, Yang Fu, Qiushan Guo 等NeurIPS 2024 · 被引用 412 次
- What does CLIP know about a red circle? Visual prompt engineering for VLMsAleksandar Shtedritski, Christian Rupprecht, Andrea VedaldiICCV 2023 · 被引用 262 次
- PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMsSoroush Nasiriany, Fei Xia, Wenhao Yu, Ted Xiao 等ICML 2024 · 被引用 212 次
相关 Paper
- Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery SimulationPhillip Y. Lee, Jihyeon Je, Chanho Park, Leonidas J. Guibas 等ICCV 2025 · 被引用 6 次
- TopViewRS: Vision-Language Models as Top-View Spatial ReasonersChengzu Li, Caiqi Zhang, Han Zhou, Nigel Collier 等EMNLP 2024 · 被引用 5 次
- Unleashing Spatial Reasoning in Multimodal Large Language Models via Textual Representation Guided ReasoningJiacheng Hua, Yishu Yin, Yuhang Wu, Tai Wang 等ACL 2026 · 被引用 5 次
- Pursuing Minimal Sufficiency in Spatial ReasoningYejie Guo, Yunzhong Hou, Wufei Ma, Meng Tang 等ICLR 2026 · 被引用 3 次
- 3ViewSense: Spatial and Mental Perspective Reasoning from Orthographic Views in Vision-Language ModelsShaoxiong Zhan, Yanlin Lai, Zheng Liu, Zijian Lin 等ICML 2026 · 被引用 6 次
