Self-supervised AutoFlow
Hsin-Ping Huang, Charles Herrmann, Junhwa Hur, Erika Lu, Kyle Sargent, Austin Stone, Ming-Hsuan Yang, Deqing Sun
Abstract
Recently, AutoFlow has shown promising results on learning a training set for optical flow, but requires ground truth labels in the target domain to compute its search metric. Observing a strong correlation between the ground truth search metric and self-supervised losses, we introduce self-supervised AutoFlow to handle real-world videos without ground truth labels. Using self-supervised loss as the search metric, our self-supervised AutoFlow performs on par with AutoFlow on Sintel and KITTI where ground truth is available, and performs better on the real-world DAVIS dataset. We further explore using self-supervised AutoFlow in the (semi-)supervised setting and obtain competitive results against the state of the art.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8f9f0b27-242d-440a-9e02-d775aab54f3dCited by top-tier papers6
- What Makes Good Synthetic Training Data for Zero-Shot Stereo Matching?David Yan, Alexander Raistrick, Jia DengCVPR 2026 · 8 citations
- UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything ModelShuai Yuan, Lei Luo, Zhuo Hui, Can Pu et al.CVPR 2024 · 7 citations
- Point Prompting: Counterfactual Tracking with Video Diffusion ModelsAyush Shrivastava, Sanyam Mehta, Daniel Geng, Andrew OwensICLR 2026 · 5 citations
- M2Flow: A Motion Information Fusion Framework for Enhanced Unsupervised Optical Flow Estimation in Autonomous DrivingXunpei Sun, Gang Chen, Zuoxun HouAAAI 2025 · 4 citations
- Learning Large Motion Estimation from Intermediate Representations with a High-Resolution Optical Flow Dataset Featuring Long-Range Dynamic MotionHoonhee Cho, Yuhwan Jeong, Kuk-Jin YoonICCV 2025
Builds on12
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Vision Transformers for Dense PredictionRené Ranftl, Alexey Bochkovskiy, Vladlen KoltunICCV 2021 · 2,647 citations
- Perceiver IO: A General Architecture for Structured Inputs & OutputsAndrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch et al.ICLR 2022 · 797 citations
- Learning to Estimate Hidden Motions with Global Motion AggregationShihao Jiang, Dylan Campbell, Yao Lu, Hongdong Li et al.ICCV 2021 · 402 citations
- Kubric: A scalable dataset generatorKlaus Greff, Francois Belletti, Lucas Beyer, Carl Doersch et al.CVPR 2022 · 183 citations
Related papers
- ADFactory: An Effective Framework for Generalizing Optical Flow With NeRFHan Ling, Quansen Sun, Yinghui Sun, Xian Xu et al.CVPR 2024
- Just Go With the Flow: Self-Supervised Scene Flow EstimationHimangi Mittal, Brian Okorn, David HeldCVPR 2020
- Flow2Stereo: Effective Self-Supervised Learning of Optical Flow and Stereo MatchingPengpeng Liu, Irwin King, Michael R. Lyu, Jia XuCVPR 2020
- SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous DrivingShuai Yuan, Shuzhi Yu, Hannah Kim, Carlo TomasiICCV 2023 · 13 citations
- Learning Fine-Grained Features for Pixel-wise Video CorrespondencesRui Li, Shenglong Zhou, Dong LiuICCV 2023 · 7 citations
