Does Reasoning Improve Seeing? Understanding When Vision-Language Models Benefit from Thinking
Jing Bi, Luchuan Song, Dingxin Zhang, Pinxin Liu, Guangyu Sun, Lianggong Wen, Weidong Cai, Chen Chen, Chenliang Xu
Abstract
Vision-language models (VLMs) now support both direct Instruct and explicit-reasoning Thinking modes, yet practitioners still lack principled ways to decide when reasoning actually improves performance, or how much computation to spend at test time, so we investigate whether VLMs encode meta-cognitive signals for adaptive inference. We derive oracle labels for two properties: (1) reasoning helpfulness, namely whether explicit reasoning improves accuracy, and (2) desired generation length, the minimal token budget needed for a correct answer. Probing final-layer representations in InternVL and Qwen3-VL models, we find Thinking models encode these signals more linearly than Instruct models, suggesting that reasoning-oriented training enhances meta-cognitive structure. Head-wise attribution reveals two circuits: length-control heads in lower layers and reasoning/difficulty heads in higher layers. Causal interventions confirm these roles across benchmarks: scaling length heads controls output length with minimal accuracy loss, while scaling reasoning heads enables a perception-reasoning trade-off, improving accuracy by up to 5.3%. Our results demonstrate that reasoning-tuned VLMs develop localized, manipulable circuits for meta-cognitive control, enabling test-time steering of computation and reasoning without retraining.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d89f17c9-d715-4b57-ad4c-7450e6a3b33fBuilds on22
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
- Let's Verify Step by StepHunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards et al.ICLR 2024 · 3,045 citations
- Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question AnsweringPan Lu, Swaroop Mishra, Tanglin Xia, Liang Qiu et al.NeurIPS 2022 · 2,727 citations
- Graph of Thoughts: Solving Elaborate Problems with Large Language ModelsMaciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger et al.AAAI 2024 · 1,292 citations
Related papers
- When to Think and When to Look: Uncertainty-Guided LookbackJing Bi, Filippos Bellos, JunJia Guo, Yayuan Li et al.CVPR 2026 · 4 citations
- ReaGEN: Adaptive Generation of Structured Chains-of-Thought for Efficient Multimodal ReasoningRuiqing Tian, Mohan Sai Singamsetti, Di Niu, Bahador RashidiCVPR 2026
- SPARC: Separating Perception And Reasoning Circuits for Test-time Scaling of VLMsNiccolò Avogaro, Nayanika Debnath, Li Mi, Thomas Frick et al.ICML 2026
- ERGO: Efficient High-Resolution Visual Understanding for Vision-Language ModelsJewon Lee, Wooksu Shin, Seungmin Yang, Ki-Ung Song et al.ICLR 2026 · 3 citations
- Think Deep, Not Just Long: Measuring LLM Reasoning Effort via Deep-Thinking TokensWei-Lin Chen, Liqian Peng, Tian Tan, Chao Zhao et al.ICML 2026 · 20 citations
