VideoTrace-R1: Long Video-based Retrieval-Augmented Generation via Reinforcement Learning
Zongsheng Cao, Anran Liu, Jun Xie, Feng Chen, Lang Chen, Jing Li, zhepeng Wang, Zigan Wang
Abstract
Long-video temporal reasoning remains a bottleneck for Large Video Language Models (LVLMs). Existing reinforcement-learning approaches reward only final-answer correctness, so they cannot distinguish answers reached through grounded reasoning from those reached through fabricated chronology; the intermediate temporal claims that constitute the reasoning are never verified. We trace this gap to a structural correspondence between two kinds of traces: a video has its own temporal trace, an ordered sequence of how events unfold, while a model's answer is built up through a reasoning trace, an ordered sequence of intermediate temporal claims. Correct reasoning requires the latter to mirror the former, claim by claim. We act on this correspondence with two contributions. We introduce Temporal Reasoning Traces (TRT), a structured index of a video's ordered event chains that exposes a small set of deterministic verification primitives, materializing the temporal trace as a programmatically queryable object. We then propose temporal-enhanced GRPO, a reinforcement-learning procedure whose reward decomposes into per-block components, each computed by a TRT primitive on a typed think block of the reasoning trace. Because the reward is fully symbolic, fabricated temporal claims are caught at the per-claim level rather than masked by a correct final answer. Across long-video reasoning benchmarks, our model achieves state-of-the-art performance, with the largest gains on out-of-domain reasoning tasks such as Video-Holmes, CG-Bench-Reasoning, and VRBench.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9480bada-db36-4e6d-9f33-b271dd8517efBuilds on26
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations
- MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsDeyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li et al.ICLR 2024 · 3,079 citations
- Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsPeter Tong, Ellis Brown, Penghao Wu, Sanghyun Woo et al.NeurIPS 2024 · 1,004 citations
- Video-R1: Reinforcing Video Reasoning in MLLMsKaituo Feng, Kaixiong Gong, Bohao Li, Zonghao Guo et al.NeurIPS 2025 · 528 citations
Related papers
- TimeSearch-R: Adaptive Temporal Search for Long-Form Video Understanding via Self-Verification Reinforcement LearningJunwen Pan, Qizhe Zhang, Rui Zhang, Ming Lu et al.ICLR 2026 · 20 citations
- TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement LearningTao Wu, Li Yang, Gen Zhan, Yabin ZHANG et al.CVPR 2026 · 7 citations
- Temporal-Aware Reasoning Optimization for Video Temporal GroundingMinghang Zheng, Zihao Yin, YI YANG, Yuxin Peng et al.ICML 2026
- ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data SynthesisCongzhi Zhang, Zhibin Wang, Yinchao Ma, Jiawei Peng et al.ICLR 2026 · 24 citations
- VR-Thinker: Boosting Multimodal Reward Models through Think with Image ReasoningQunzhong Wang, Jie Liu, Jiajun Liang, Yuanxing Zhang et al.ICML 2026 · 10 citations
