Ascending the Infinite Ladder: Benchmarking Spatial Deformation Reasoning in Vision-Language Models
Jiahuan Zhang, Shunwen Bai, Tianheng Wang, Kaiwen Guo, Zijia Song, Hanqing Wu, Guozheng Rao, Kai Han, Kaicheng Yu
Abstract
Under review. (given the final state, determine the operations). We adopt a ladder competition format, using the number of deformation steps as the level classification criterion, with the goal of exploring the boundaries of the model's deformation reasoning capabilities. Interestingly, the benchmarking results reveal that almost no model demonstrates plausible spatial deformation reasoning abilities. Furthermore, even after applying targeted training and mainstream reasoning enhancement methods, the models are still unable to perform well on 3D spatial deformation reasoning. Spatial Deformation Reasoning In this study, spatial deformation reasoning refers to the model's ability to understand, predict, and execute complex deformations of an object's shape. We focus on implementing this reasoning in VLMs, especially when there is no prior knowledge, and the model must learn and perform deformations through observation or manipulation. Unlike visual spatial intelligence in the VSI-Bench [56] , which emphasizes localization, relational understanding, and spatial perception, our spatial deformation centers on dynamic shape transformations, particularly in multi-step processes that change an object's state. We categorize the core capabilities of spatial deformation as follows: Spatial Recognition. The ability to comprehend the initial shape of an object and accurately identify the areas that require deformation. Abstraction of Operational Law Principles. The ability to grasp the principles behind deformation operations and abstract them into deformation laws, crucial for accurate reasoning. Stable Reasoning Execution. The ability to gradually execute the inferred reasoning rules, maintain stability throughout the process, and derive the final state.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on18
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
- Graph of Thoughts: Solving Elaborate Problems with Large Language ModelsMaciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger et al.AAAI 2024 · 1,292 citations
- AlphaZero-Like Tree-Search can Guide Large Language Model Decoding and TrainingZiyu Wan, Xidong Feng, Muning Wen, Stephen Marcus McAleer et al.ICML 2024 · 325 citations
Related papers
- 3DSRBENCH: A Comprehensive 3D Spatial Reasoning BenchmarkWufei Ma, Haoyu Chen, Guofeng Zhang, Yu-Cheng Chou et al.ICCV 2025 · 15 citations
- Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed SpacesChen Yang, Guanxin Lin, Youquan He, Peiyao Chen et al.ICML 2026
- SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language ModelsHongxing Li, Dingming Li, Zixuan Wang, Yuchen Yan et al.ICLR 2026 · 75 citations
- Spatial-DISE: A Unified Benchmark for Evaluating Spatial Reasoning in Vision-Language ModelsXinmiao Huang, Qisong He, Zhenglin Huang, Boxuan Wang et al.ICLR 2026 · 8 citations
- SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D PriorsChenyang Ma, Kai Lu, Ta Ying Cheng, Niki Trigoni et al.NeurIPS 2024 · 82 citations
