Lune

AAAI2026Top-tier venue

Video Spatial Reasoning with Object-Centric 3D Rollout

Haoran Tang, Meng Cao, Ruyang Liu, Xiaoxi Liang, Linglong Li, Ge Li, Xiaodan Liang

2026Year
3Citations
2Top-tier citations

Abstract

Video-R1: (Only mentioned objects) <think>Let me think about this carefully. If I am standing by the pillow and facing the radiator, I need to determine the direction of the laptop relative to my position. Wait, let's break it down. If I am facing the radiator, that means I am facing towards the back of the room. The laptop is on the right side of the room, so it would be to my right. Hmm, if I am facing the radiator and the laptop is to my right, it would be to my front-right. Oh, I see. The laptop is not to my back, so options C and D are not correct. The laptop is not to my left, so option A is not correct. Therefore, the laptop is to my front-right.</think> <answer>B</answer> Ours: (More relevant objects for spatial reasoning) <think>Let me think about this for a moment. If I am standing by the pillow and facing the radiator, I need to determine the position of the laptop relative to me. First, let's break it down. If I am facing the radiator, I am looking towards the back of the room. The pillow is to my left, and it is to the right of the bed, so if I am standing by the pillow, I am facing the radiator from the front. Now, let's consider the laptop. The laptop is on the desk, and the desk is to the left of the bed. If I am facing the radiator, the laptop is not directly in front of me, but rather to the left of the bed. Hmm, if I am standing by the pillow and facing the radiator, the laptop is not to my back, as it is to the left of the bed. It is also not to my right, as it is to the left of the bed. Wait, if the laptop is to the left of the bed and I am facing the radiator, it must be to my front-left. Oh, I see. The laptop is to my front-left. Let's verify. If I am standing by the pillow and facing the radiator, the laptop is indeed to my front-left. Therefore, the laptop is to my front-left.</think> <answer>A</answer> Problem: Object Relative Direction Question: If I am standing by the pillow and facing the radiator, is the laptop to my A. front-left, B. front-right, C. back-left, or D. back-right? (Ground Truth: A) ries. Experiments demonstrate state-of-the-art performance: our 3B-parameter model achieves 47.5% accuracy on VSI-Bench, outperforming several 7B baselines. Ablations confirm OCR's superiority over prior rollout strategies (e.g., T-GRPO, NoisyRollout).

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

Cited by top-tier papers2

Ask how each one uses it

Builds on13

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines