M2Flow: A Motion Information Fusion Framework for Enhanced Unsupervised Optical Flow Estimation in Autonomous Driving
Xunpei Sun, Gang Chen, Zuoxun Hou
Abstract
Estimating optical flow in occluded regions is a crucial challenge in unsupervised settings. In this work, we introduce M2Flow, a novel framework for unsupervised optical flow estimation that integrates motion information from multiple frames to address occlusions. By modeling inter-frame motion information and employing Motion Information Propagation (MIP) module, M2Flow effectively propagates and integrates motion information across frames, while concurrently estimating bidirectional optical flows for multiple frames. In addition, to handle occlusions across multiple frames, we provide two augmentation modules specifically designed for our multi-frame model to further refine optical flow. The experiments on KITTI and Sintel datasets demonstrate that M2Flow outperforms other state-of-the-art unsupervised approaches, especially in solving occlusions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 983cf440-ea9d-4e5e-bf72-8c6af7daf682Cited by top-tier papers1
Ask how each one uses itBuilds on14
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow EstimationXiaoyu Shi, Zhaoyang Huang, Weikang Bian, Dasong Li et al.ICCV 2023 · 112 citations
- SKFlow: Learning Optical Flow with Super KernelsShangkun Sun, Yuanqi Chen, Yu Zhu, Guodong Guo et al.NeurIPS 2022 · 97 citations
- Optical Flow in Deep Visual TrackingMikko Vihlman, Arto VisalaAAAI 2020 · 17 citations
- SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous DrivingShuai Yuan, Shuzhi Yu, Hannah Kim, Carlo TomasiICCV 2023 · 13 citations
Related papers
- MaskFlownet: Asymmetric Feature Matching With Learnable Occlusion MaskShengyu Zhao, Yilun Sheng, Yue Dong, Eric I-Chao Chang et al.CVPR 2020
- Every Frame Counts: Joint Learning of Video Segmentation and Optical FlowMingyu Ding, Zhe Wang, Bolei Zhou, Jianping Shi et al.AAAI 2020 · 80 citations
- SMURF: Self-Teaching Multi-Frame Unsupervised RAFT With Full-Image WarpingAustin Stone, Daniel Maurer, Alper Ayvaci, Anelia Angelova et al.CVPR 2021
- Many-to-many Splatting for Efficient Video Frame InterpolationPing Hu, Simon Niklaus, Stan Sclaroff, Kate SaenkoCVPR 2022 · 63 citations
- Self-Supervised Multi-Frame Monocular Scene FlowJunhwa Hur, Stefan RothCVPR 2021
