ARES: Unifying Asymmetric RGB-Event Stereo for Probabilistic Scene Flow Estimation
Jie Long Lee, Gim Hee Lee
Abstract
Estimating dense three dimensional motion in dynamic high speed scenes remains challenging due to motion blur, illumination variation, and the limited temporal resolution of conventional cameras. We introduce ARES, a unified framework for Asymmetric RGB-Event Stereo that addresses these issues through a hybrid setup where an event camera captures fine grained temporal dynamics and an RGB camera provides rich spatial structure. To integrate these heterogeneous modalities, we propose Multimodal Contextual Attention, a transformer based fusion mechanism that attends to spatial and temporal contexts under cross view constraints and forms a unified correspondence space for disparity and optical flow estimation. Building on this shared representation, we introduce Temporal Disparity Posterior Fusion, a probabilistic framework that models the evolution of disparity posteriors to infer disparity change and recover metrically coherent scene flow. Trained with sparse supervision and dense self consistency cues, our ARES achieves geometrically consistent and temporally stable three dimensional motion estimation across diverse driving scenarios. Experiments show that ARES attains state of the art performance in scene flow estimation, establishing a principled path toward unified asymmetric multimodal stereo sensing. Our code will be released upon paper acceptance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D CamerasZachary Teed, Jia DengNeurIPS 2021 · 1,248 citations
- Perceiver IO: A General Architecture for Structured Inputs & OutputsAndrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch et al.ICLR 2022 · 797 citations
- SLIM: Self-Supervised LiDAR Scene Flow and Motion SegmentationStefan Andreas Baur, David Josef Emmerichs, Frank Moosmann, Peter Pinggera et al.ICCV 2021 · 110 citations
- Zero-Shot Event-Intensity Asymmetric Stereo via Visual Prompting from Image DomainHanyue Lou, Jinxiu (Sherry) Liang, Minggui Teng, Bin Fan et al.NeurIPS 2024 · 13 citations
- EMatch: A Unified Framework for Event-Based Optical Flow and Stereo MatchingPengjie Zhang, Lin Zhu, Xiao Wang, Lizhi Wang et al.ICCV 2025 · 2 citations
Related papers
- RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow EstimationZhexiong Wan, Yuxin Mao, Jing Zhang, Yuchao DaiICCV 2023 · 35 citations
- Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric StereoNinghui Xu, Fabio Tosi, Lihui Wang, Jiawei Han et al.CVPR 2026
- x^2-Fusion: Cross-Modality and Cross-Dimension Flow Estimation in Event Edge SpaceRuishan Guo, Ciyu Ruan, Haoyang Wang, Zihang Gong et al.CVPR 2026
- HAFUNet: A Hierarchical Attention Fusion Network for Monocular Depth Estimation Integrating Event and Frame DataSiyuan Zhang, Xiaoping Wang, Jiang Li, Weibin Feng et al.ACM MM 2025
- Deep Event Stereo Leveraged by Event-to-Image TranslationSoikat Hasan Ahmed, Hae Woong Jang, S. M. Nadim Uddin, Yong Ju JungAAAI 2021 · 41 citations
