ICML2026
Does Reasoning Improve Seeing? Understanding When Vision-Language Models Benefit from Thinking
Jing Bi, Luchuan Song, Dingxin Zhang, Pinxin Liu, Guangyu Sun, Lianggong Wen, Weidong Cai, Chen Chen, Chenliang Xu
摘要
Vision-language models (VLMs) now support both direct Instruct and explicit-reasoning Thinking modes, yet practitioners still lack principled ways to decide when reasoning actually improves performance, or how much computation to spend at test time, so we investigate whether VLMs encode meta-cognitive signals for adaptive inference. We derive oracle labels for two properties: (1) reasoning helpfulness, namely whether explicit reasoning improves accuracy, and (2) desired generation length, the minimal token budget needed for a correct answer. Probing final-layer representations in InternVL and Qwen3-VL models, we find Thinking models encode these signals more linearly than Instruct models, suggesting that reasoning-oriented training enhances meta-cognitive structure. Head-wise attribution reveals two circuits: length-control heads in lower layers and reasoning/difficulty heads in higher layers. Causal interventions confirm these roles across benchmarks: scaling length heads controls output length with minimal accuracy loss, while scaling reasoning heads enables a perception-reasoning trade-off, improving accuracy by up to 5.3%. Our results demonstrate that reasoning-tuned VLMs develop localized, manipulable circuits for meta-cognitive control, enabling test-time steering of computation and reasoning without retraining.