Event-based Visual Deformation Measurement
Yuliang Wu, Wei Zhai, Yuxin Cui, Tiesong Zhao, Yang Cao, Zheng-Jun Zha
摘要
Visual Deformation Measurement (VDM) aims to recover dense deformation fields by tracking surface motion from camera observations. Traditional image-based methods rely on minimal inter-frame motion to constrain the correspondence search space, which limits their applicability to highly dynamic scenes or necessitates high-speed cameras at the cost of prohibitive storage and computational overhead.We propose an event-frame fusion framework that exploits events for temporally dense motion cues and frames for spatially dense precise estimation.By revisiting the solid elastic modeling prior, we propose an Affine Invariant Simplicial (AIS) framework that partitions the deformation field into multiple sub-regions and linearize the deformation within each sub-region using a low-parametric representation, effectively mitigating motion ambiguities arising from the sparse and noisy nature of event observations. To speed up parameter searching and reduce error accumulation, a neighborhood-greedy optimization strategy is introduced, enabling well-converged sub-regions to guide their poorly-converged neighbors, effectively suppress local error accumulation in long-term dense tracking.To evaluate the proposed method, a benchmark dataset with temporally aligned event streams and high-frame-rate videos is established, encompassing over 120 sequences spanning diverse deformation scenarios. Experimental results show that the proposed method outperforms the state-of-the-art baseline by 1.6× in terms of continuous measurement success rate (survival rate). Remarkably, our approach achieves superior performance while requiring only 18.9% of the data storage and processing resources compared to traditional high-speed video-based methods, without compromising accuracy.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point TrackingYang Zheng, Adam W. Harley, Bokui Shen, Gordon Wetzstein 等ICCV 2023 · 被引用 255 次
- Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural NetworksJesse J. Hagenaars, Federico Paredes-Vallés, Guido de CroonNeurIPS 2021 · 被引用 178 次
- Time Lens++: Event-based Frame Interpolation with Parametric Nonlinear Flow and Multi-scale FusionStepan Tulyakov, Alfredo Bochicchio, Daniel Gehrig, Stamatios Georgoulis 等CVPR 2022 · 被引用 126 次
- Taming Contrast Maximization for Learning Sequential, Low-latency, Event-based Optical FlowFederico Paredes-Vallés, Kirk Y. W. Scheper, Christophe De Wagter, Guido C. H. E. de CroonICCV 2023 · 被引用 43 次
- EF-3DGS: Event-Aided Free-Trajectory 3D Gaussian SplattingBohao Liao, Wei Zhai, Zengyu Wan, Zhixin Cheng 等NeurIPS 2025 · 被引用 19 次
相关 Paper
- TimeTracker: Event-based Continuous Point Tracking for Video Frame Interpolation with Non-linear MotionHaoyue Liu, Jinghan Xu, Yi Chang, Hanyu Zhou 等CVPR 2025
- Event-Aided Dense and Continuous Point Tracking: Everywhere and AnytimeZhexiong Wan, Jianqin Luo, Yuchao Dai, Gim Hee LeeICCV 2025 · 被引用 1 次
- Event6D: Event-based Novel Object 6D Pose TrackingJae-Young Kang, Hoonhee Cho, Taeyeop Lee, Minjun Kang 等CVPR 2026 · 被引用 4 次
- EvSTVSR: Event Guided Space-Time Video Super-ResolutionHaojie Yan, Zhan Lu, Zehao Chen, De Ma 等AAAI 2025 · 被引用 6 次
- MATE: Motion-Augmented Temporal Consistency for Event-Based Point TrackingHan Han, Wei Zhai, Yang Cao, Bin Li 等ICCV 2025 · 被引用 3 次
