Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding
Jiaqi Tang, Jianmin Chen, Wei Wei, Xiaogang Xu, Runtao Liu, Xiangyu Wu, Qipeng Xie, Jiafei Wu, Lei Zhang, Qifeng Chen
摘要
Multimodal Large Language Models struggle to maintain reliable performance under extreme real-world visual degradations, which impede their practical robustness. Existing robust MLLMs predominantly rely on implicit training/adaptation that focuses solely on visual encoder generalization, suffering from limited interpretability and isolated optimization. To overcome these limitations, we propose Robust-R1, a novel framework that explicitly models visual degradations through structured reasoning chains. Our approach integrates: (i) supervised fine-tuning for degradation-aware reasoning foundations, (ii) reward-driven alignment for accurately perceiving degradation parameters, and (iii) dynamic reasoning depth scaling adapted to degradation intensity. To facilitate this approach, we introduce a specialized 11K dataset featuring realistic degradations synthesized across four critical real-world visual processing stages, each annotated with structured chains connecting degradation parameters, perceptual influence, pristine semantic reasoning chain, and conclusion. Comprehensive evaluations demonstrate state-of-theart robustness: Robust-R1 outperforms all general and robust baselines on the real-world degradation benchmark R-Bench, while maintaining superior anti-degradation performance under multi-intensity adversarial degradations on MMMB, MMStar, and RealWorldQA. Code -github.com/jqtangust/Robust-R1 Data -huggingface.co/datasets/Jiaqi-hkust/Robust-R1 Model -huggingface.co/Jiaqi-hkust/Robust-R1 Space -huggingface.co/spaces/Jiaqi-hkust/Robust-R1
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- LongVideoAgent: Multi-Agent Reasoning with Long VideosRuntao Liu, Ziyi Liu, Jiaqi Tang, Yue Ma 等ACL 2026 · 被引用 17 次
- Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding?Jiaqi Tang, Jianmin Chen, Youyang Zhai, Wei Wei 等ICML 2026 · 被引用 1 次
它引用的顶会 Paper11
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma 等NeurIPS 2022 · 被引用 22,562 次
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsPan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu 等ICLR 2024 · 被引用 1,472 次
- Robust CLIP: Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language ModelsChristian Schlarmann, Naman Deep Singh, Francesco Croce, Matthias HeinICML 2024 · 被引用 114 次
- V*: Guided Visual Search as a Core Mechanism in Multimodal LLMsPenghao Wu, Saining XieCVPR 2024 · 被引用 32 次
- Robust SAM: On the Adversarial Robustness of Vision Foundation ModelsJiahuan Long, Zhengqin Xu, Tingsong Jiang, Wen Yao 等AAAI 2025 · 被引用 5 次
相关 Paper
- Uni-DocRobust: Universal Plug-and-Play Robustness Enhancement for Multi-modal LLMs via Feature RestorationYuxuan Zhou, Baole Wei, Xingjian Hu, Haowei Chen 等ICML 2026
- R1-Onevision: Advancing Generalized Multimodal Reasoning Through Cross-Modal FormalizationYi Yang, Xiaoxuan He, Hongkun Pan, Xiyan Jiang 等ICCV 2025 · 被引用 21 次
- Benchmarking Multimodal Large Language Models Against Image CorruptionsXinkuan Qiu, Meina Kan, Yongbin Zhou, Shiguang ShanICCV 2025 · 被引用 1 次
- Predictive Regularization Against Visual Representation Degradation in Multimodal Large Language ModelsEnguang Wang, Qiang Wang, Yuanchen Wu, Ke Yan 等CVPR 2026
- Seeing is Believing? Mitigating OCR Hallucinations in Multimodal Large Language ModelsZhentao He, Can Zhang, Ziheng Wu, Zhenghao Chen 等NeurIPS 2025 · 被引用 14 次
