FM-Steer: Enhance Generalist Policies with Value-Guided Cascaded Denoising
Haoming Song, Delin Qu, Yuanqi Yao, Qizhi Chen, Jiarui Li, Qi Lv, Yiwen Tang, Li Kang, Heng Zhou, Xianqiang Gao, Yuhang Tang, Xiaofan Li
Abstract
Humans naturally allocate more time before performing actual actions when handling complex tasks in the physical world. This paradigm, recently, has achieved remarkable advancement in boosting Large Language Models (LLMs) to solve complex tasks in digital domains.However, the potential of test-time computing remains largely unexplored for robotic foundation models interacting with the physical world.In this work, we propose ****: a test-time computing framework that augments flow-based Vision-Language-Action (VLA) generalist policies with value-guided sampling and cascaded action denoising, enabling higher control performance and real-time action rates for dexterous robot manipulation.first incorporates a flow-based intermediate verifier to estimate state–action values for candidate actions. At test time, the policy iteratively samples multiple noisy action proposals and retains the one with the highest predicted value, yielding value-aligned, high-quality actions without retraining.To satisfy the stringent frequency demands of robot control, further introduces cascaded action denoising, decoupling expensive value-guided sampling from fast action refinement. A lightweight flow denoiser asynchronously takes the selected high-value noisy action and rapidly denoises it to produce the final control signal, enabling fluid, high-rate execution.During deployment, the intermediate verifier operates at a low frequency to provide value-guided sampling, while the lite-flow denoiser continually processes selected candidates to maintain real-time control.Extensive experiments demonstrate that scales flow-based VLA models effectively at test time, and achieves state-of-the-art performance across diverse simulation benchmarks and real-world dexterous robotic tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on30
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
- Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language ModelsSiddharth Karamcheti, Suraj Nair, Ashwin Balakrishna, Percy Liang et al.ICML 2024 · 306 citations
- Cal-QL: Calibrated Offline RL Pre-Training for Efficient Online Fine-TuningMitsuhiko Nakamoto, Simon Zhai, Anikait Singh, Max Sobol Mark et al.NeurIPS 2023 · 296 citations
- FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous DrivingShuang Zeng, Xinyuan Chang, Mengwei Xie, Xinran Liu et al.NeurIPS 2025 · 228 citations
Related papers
- On-the-Fly VLA Adaptation via Test-Time Reinforcement LearningChangyu Liu, Yiyang Liu, Taowen Wang, Qiao Zhuang et al.ACL 2026 · 7 citations
- FreqPolicy: Efficient Flow-based Visuomotor Policy via Frequency ConsistencyYifei Su, Ning Liu, Dong Chen, Zhen Zhao et al.NeurIPS 2025 · 20 citations
- Verifier-free Test-Time Sampling for Vision-Language-Action ModelsSuhyeok Jang, Dongyoung Kim, Changyeon Kim, Youngsuk Kim et al.ICLR 2026 · 25 citations
- VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic ModelWenhao Li, Xiu Su, Yichao Cao, Hongyan Xu et al.ICML 2026 · 13 citations
- VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token CachingSiyu Xu, Yunke Wang, Chenghao Xia, Dihao Zhu et al.NeurIPS 2025 · 95 citations
