AAAI2026
Video Spatial Reasoning with Object-Centric 3D Rollout
Haoran Tang, Meng Cao, Ruyang Liu, Xiaoxi Liang, Linglong Li, Ge Li, Xiaodan Liang
被引用 3 次
摘要
Video-R1: (Only mentioned objects) <think>Let me think about this carefully. If I am standing by the pillow and facing the radiator, I need to determine the direction of the laptop relative to my position. Wait, let's break it down. If I am facing the radiator, that means I am facing towards the back of the room. The laptop is on the right side of the room, so it would be to my right. Hmm, if I am facing the radiator and the laptop is to my right, it would be to my front-right. Oh, I see. The laptop is not to my back, so options C and D are not correct. The laptop is not to my left, so option A is not correct. Therefore, the laptop is to my front-right.</think> <answer>B</answer> Ours: (More relevant objects for spatial reasoning) <think>Let me think about this for a moment. If I am standing by the pillow and facing the radiator, I need to determine the position of the laptop relative to me. First, let's break it down. If I am facing the radiator, I am looking towards the back of the room. The pillow is to my left, and it is to the right of the bed, so if I am standing by the pillow, I am facing the radiator from the front. Now, let's consider the laptop. The laptop is on the desk, and the desk is to the left of the bed. If I am facing the radiator, the laptop is not directly in front of me, but rather to the left of the bed. Hmm, if I am standing by the pillow and facing the radiator, the laptop is not to my back, as it is to the left of the bed. It is also not to my right, as it is to the left of the bed. Wait, if the laptop is to the left of the bed and I am facing the radiator, it must be to my front-left. Oh, I see. The laptop is to my front-left. Let's verify. If I am standing by the pillow and facing the radiator, the laptop is indeed to my front-left. Therefore, the laptop is to my front-left.</think> <answer>A</answer> Problem: Object Relative Direction Question: If I am standing by the pillow and facing the radiator, is the laptop to my A. front-left, B. front-right, C. back-left, or D. back-right? (Ground Truth: A) ries. Experiments demonstrate state-of-the-art performance: our 3B-parameter model achieves 47.5% accuracy on VSI-Bench, outperforming several 7B baselines. Ablations confirm OCR's superiority over prior rollout strategies (e.g., T-GRPO, NoisyRollout).