VideoTrace-R1: Long Video-based Retrieval-Augmented Generation via Reinforcement Learning
Zongsheng Cao, Anran Liu, Jun Xie, Feng Chen, Lang Chen, Jing Li, zhepeng Wang, Zigan Wang
摘要
Long-video temporal reasoning remains a bottleneck for Large Video Language Models (LVLMs). Existing reinforcement-learning approaches reward only final-answer correctness, so they cannot distinguish answers reached through grounded reasoning from those reached through fabricated chronology; the intermediate temporal claims that constitute the reasoning are never verified. We trace this gap to a structural correspondence between two kinds of traces: a video has its own temporal trace, an ordered sequence of how events unfold, while a model's answer is built up through a reasoning trace, an ordered sequence of intermediate temporal claims. Correct reasoning requires the latter to mirror the former, claim by claim. We act on this correspondence with two contributions. We introduce Temporal Reasoning Traces (TRT), a structured index of a video's ordered event chains that exposes a small set of deterministic verification primitives, materializing the temporal trace as a programmatically queryable object. We then propose temporal-enhanced GRPO, a reinforcement-learning procedure whose reward decomposes into per-block components, each computed by a TRT primitive on a typed think block of the reasoning trace. Because the reward is fully symbolic, fabricated temporal claims are caught at the per-claim level rather than masked by a correct final answer. Across long-video reasoning benchmarks, our model achieves state-of-the-art performance, with the largest gains on out-of-domain reasoning tasks such as Video-Holmes, CG-Bench-Reasoning, and VRBench.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper26
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 被引用 7,873 次
- MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsDeyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li 等ICLR 2024 · 被引用 3,079 次
- Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsPeter Tong, Ellis Brown, Penghao Wu, Sanghyun Woo 等NeurIPS 2024 · 被引用 1,004 次
- Video-R1: Reinforcing Video Reasoning in MLLMsKaituo Feng, Kaixiong Gong, Bohao Li, Zonghao Guo 等NeurIPS 2025 · 被引用 528 次
相关 Paper
- TimeSearch-R: Adaptive Temporal Search for Long-Form Video Understanding via Self-Verification Reinforcement LearningJunwen Pan, Qizhe Zhang, Rui Zhang, Ming Lu 等ICLR 2026 · 被引用 20 次
- TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement LearningTao Wu, Li Yang, Gen Zhan, Yabin ZHANG 等CVPR 2026 · 被引用 7 次
- Temporal-Aware Reasoning Optimization for Video Temporal GroundingMinghang Zheng, Zihao Yin, YI YANG, Yuxin Peng 等ICML 2026
- ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data SynthesisCongzhi Zhang, Zhibin Wang, Yinchao Ma, Jiawei Peng 等ICLR 2026 · 被引用 24 次
- VR-Thinker: Boosting Multimodal Reward Models through Think with Image ReasoningQunzhong Wang, Jie Liu, Jiajun Liang, Yuanxing Zhang 等ICML 2026 · 被引用 10 次
