Lune

NeurIPS2025Top-tier venue

ST2^2360D: Spatial-to-Temporal Consistency for Training-free 360 Monocular Depth Estimation

Zidong Cao, Jinjing Zhu, Hao Ai, Lutao Jiang, Yuanhuiyi Lyu, Hui Xiong

2025Year
1Citations

Abstract

• monocular depth estimation plays a crucial role in scene understanding owing to its 180 • × 360 • field-of-view (FoV). To mitigate the distortions brought by equirectangular projection, existing methods typically divide 360 • images into distortion-less perspective patches. However, since these patches are processed independently, depth inconsistencies are often introduced due to scale drift among patches. Recently, video depth estimation (VDE) models have leveraged temporal consistency for stable depth predictions across frames. Inspired by this, we propose to represent a 360 • image as a sequence of perspective frames, mimicking the viewpoint adjustments users make when exploring a 360 • scenario in virtual reality. Thus, the spatial consistency among perspective depth patches can be enhanced by exploiting the temporal consistency inherent in VDE models. To this end, we introduce a training-free pipeline for 360 • monocular depth estimation, called ST 2 360D. Specifically, ST 2 360D transforms a 360 • image into perspective video frames, predicts video depth maps using VDE models, and seamlessly merges these predictions into a complete 360 • depth map. To generate sequenced perspective frames that align with VDE models, we propose two tailored strategies. First, a spherical-uniform sampling (SUS) strategy is proposed to facilitate uniform sampling of perspective views across the sphere, avoiding oversampling in polar regions typically with limited structural details. Second, a latitude-guided scanning (LGS) strategy is introduced to organize the frames into a coherent sequence, starting from the equator, prioritizing low-latitude slices, and progressively moving toward higher latitudes. Extensive experiments demonstrate that ST 2 360D achieves strong zero-shot capability on several datasets, supporting resolutions up to 4K.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext dc62bfb1-afde-4c2a-becb-3008a2d7123b

Builds on32

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines