Lune

NeurIPS2025顶会

ST2^2360D: Spatial-to-Temporal Consistency for Training-free 360 Monocular Depth Estimation

Zidong Cao, Jinjing Zhu, Hao Ai, Lutao Jiang, Yuanhuiyi Lyu, Hui Xiong

2025年份
1被引次数

摘要

• monocular depth estimation plays a crucial role in scene understanding owing to its 180 • × 360 • field-of-view (FoV). To mitigate the distortions brought by equirectangular projection, existing methods typically divide 360 • images into distortion-less perspective patches. However, since these patches are processed independently, depth inconsistencies are often introduced due to scale drift among patches. Recently, video depth estimation (VDE) models have leveraged temporal consistency for stable depth predictions across frames. Inspired by this, we propose to represent a 360 • image as a sequence of perspective frames, mimicking the viewpoint adjustments users make when exploring a 360 • scenario in virtual reality. Thus, the spatial consistency among perspective depth patches can be enhanced by exploiting the temporal consistency inherent in VDE models. To this end, we introduce a training-free pipeline for 360 • monocular depth estimation, called ST 2 360D. Specifically, ST 2 360D transforms a 360 • image into perspective video frames, predicts video depth maps using VDE models, and seamlessly merges these predictions into a complete 360 • depth map. To generate sequenced perspective frames that align with VDE models, we propose two tailored strategies. First, a spherical-uniform sampling (SUS) strategy is proposed to facilitate uniform sampling of perspective views across the sphere, avoiding oversampling in polar regions typically with limited structural details. Second, a latitude-guided scanning (LGS) strategy is introduced to organize the frames into a coherent sequence, starting from the equator, prioritizing low-latitude slices, and progressively moving toward higher latitudes. Extensive experiments demonstrate that ST 2 360D achieves strong zero-shot capability on several datasets, supporting resolutions up to 4K.

问问这篇 Paper

智能体会读完全文。

Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。

可以从这些问题问起

智能体调用

Luneget_paper_fulltext

在 Lune 里问

免费开始,无需绑卡

lune papers fulltext dc62bfb1-afde-4c2a-becb-3008a2d7123b

它引用的顶会 Paper32

相关 Paper

黄昏的海面,两侧是细线勾勒的悬崖