U^2Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation
Xunpei Sun, Wenwei Lin, Yi Chang, Gang Chen
Abstract
Unsupervised optical flow methods typically lack reliable uncertainty estimation, limiting their robustness and interpretability. We propose U 2 Flow, the first recurrent unsupervised framework that jointly estimates optical flow and per-pixel uncertainty. The core innovation is a decoupled learning strategy that derives uncertainty supervision from augmentation consistency via a Laplace-based maximum likelihood objective, enabling stable training without ground truth. The predicted uncertainty is further integrated into the network to guide adaptive flow refinement and dynamically modulate the regional smoothness loss. Furthermore, we introduce an uncertainty-guided bidirectional flow fusion mechanism that enhances robustness in challenging regions. Extensive experiments on KITTI and Sintel demonstrate that U 2 Flow achieves state-of-the-art performance among unsupervised methods while producing highly reliable uncertainty maps, validating the effectiveness of our joint estimation paradigm. The code is available at https://github.com/sunzunyi/U2FLOW .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on18
- VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow EstimationXiaoyu Shi, Zhaoyang Huang, Weikang Bian, Dasong Li et al.ICCV 2023 · 112 citations
- OcclusionFusion: Occlusion-aware Motion Estimation for Real-time Dynamic 3D ReconstructionWenbin Lin, Chengwei Zheng, Jun-Hai Yong, Feng XuCVPR 2022 · 31 citations
- Dense Optical Tracking: Connecting the DotsGuillaume Le Moing, Jean Ponce, Cordelia SchmidCVPR 2024 · 24 citations
- SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous DrivingShuai Yuan, Shuzhi Yu, Hannah Kim, Carlo TomasiICCV 2023 · 13 citations
- DiffSF: Diffusion Models for Scene Flow EstimationYushan Zhang, Bastian Wandt, Maria Magnusson, Michael FelsbergNeurIPS 2024 · 8 citations
Related papers
- M2Flow: A Motion Information Fusion Framework for Enhanced Unsupervised Optical Flow Estimation in Autonomous DrivingXunpei Sun, Gang Chen, Zuoxun HouAAAI 2025 · 4 citations
- Uncertainty-aware Unsupervised Multi-Object TrackingKai Liu, Sheng Jin, Zhihang Fu, Ze Chen et al.ICCV 2023 · 21 citations
- Learning Accurate Dense Correspondences and When To Trust ThemPrune Truong, Martin Danelljan, Luc Van Gool, Radu TimofteCVPR 2021
- DistractFlow: Improving Optical Flow Estimation via Realistic Distractions and Pseudo-LabelingJisoo Jeong, Hong Cai, Risheek Garrepalli, Fatih PorikliCVPR 2023
- Learning by Analogy: Reliable Supervision From Transformations for Unsupervised Optical Flow EstimationLiang Liu, Jiangning Zhang, Ruifei He, Yong Liu et al.CVPR 2020
