SEA-Flow3D: Simplified, Efficient, and Accurate Scene Flow via Spatial Vector Sampling and Multi-scale Refinement
Han Ling, Quansen Sun, Yinghua Yao, Ivor W. Tsang, Yinghui Sun
Abstract
Although depth-assisted scene flow estimation has advanced rapidly, mainstream dense frameworks (e.g., RAFT-3D) still rely primarily on 2D feature correlations to optimize 3D motion fields, which hinders their ability to exploit 3D structural priors effectively and consequently limits robustness in complex scenes. We present SEA-Flow3D, a simple, efficient, and accurate framework for dense scene flow estimation. At its core lies a Spatial Vector Sampling (SVS) module that jointly samples 3D coordinates and correlation volumes within the local neighborhood of matched points, producing a direction-aware correlation representation with explicit spatial vectors and providing strong geometric guidance for subsequent optimization. Following the simplicity-and-efficiency principle, SEA-Flow3D adopts a RAFT-style multi-scale recurrent refinement architecture, integrating an RNN-based optimizer with context-guided upsampling to achieve higher accuracy with fewer iterations. Extensive experiments on KITTI and Sintel demonstrate that SEA-Flow3D achieves state-of-the-art performance while maintaining remarkable efficiency and a lightweight design. Code page: https: //github.com/HanLingsgjk/SEAFLOW3D
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- Depth Anything V2Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao et al.NeurIPS 2024 · 2,305 citations
- CamLiFlow: Bidirectional Camera-LiDAR Fusion for Joint Optical Flow and Scene Flow EstimationHaisong Liu, Tao Lu, Yihui Xu, Jia Liu et al.CVPR 2022 · 64 citations
- EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AITai Wang, Xiaohan Mao, Chenming Zhu, Runsen Xu et al.CVPR 2024 · 53 citations
- Scale-flow: Estimating 3D Motion from VideoHan Ling, Quansen Sun, Zhenwen Ren, Yazhou Liu et al.ACM MM 2022 · 7 citations
- Binary TTC: A Temporal Geofence for Autonomous NavigationAbhishek Badki, Orazio Gallo, Jan Kautz, Pradeep SenCVPR 2021
Related papers
- RAFT-3D: Scene Flow Using Rigid-Motion EmbeddingsZachary Teed, Jia DengCVPR 2021
- PV-RAFT: Point-Voxel Correlation Fields for Scene Flow Estimation of Point CloudsYi Wei, Ziyi Wang, Yongming Rao, Jiwen Lu et al.CVPR 2021
- Efficient All-Pairs Correlation Volume Sampling for Optical Flow EstimationKarlis Martins Briedis, Markus Gross, Christopher SchroersCVPR 2026 · 1 citation
- Multi-Scale Bidirectional Recurrent Network with Hybrid Correlation for Point Cloud Based Scene Flow EstimationWencan Cheng, Jong Hwan KoICCV 2023 · 25 citations
- Weakly Supervised Learning of Rigid 3D Scene FlowZan Gojcic, Or Litany, Andreas Wieser, Leonidas J. Guibas et al.CVPR 2021
