FLOW: Feature-Level Optimal Warping for Generalized Remote Physiological Measurement
bo zhao, Junzhe Cao, Dan Guo, Dongmin Huang, Wenjin Wang, Tao Tan, Yue Sun, Zitong YU
Abstract
Remote photoplethysmography (rPPG) enables non-contact physiological measurement from facial videos but often suffers from severe performance degradation under domain shifts. Traditional STMap-based methods rely on predefined spatio-temporal representations that offer engineered robustness but discard fine-grained temporal cues. In contrast, end-to-end rPPG models directly learn hierarchical features from raw videos, capturing richer physiological patterns yet remaining highly sensitive to variations in illumination, motion, and camera sensors. To address these challenges, we propose FLOW (Feature-Level Optimal Warping), an Optimal Transport (OT)–driven and plug-and-play framework for multi-source domain generalization in rPPG measurement.FLOW formulates domain shifts as structured Optimal Transport problems and performs feature-level warping to align multiple source domains in a shared latent space. Specifically, a dual-consistency regularization is proposed to enforce both frequency fidelity and mapping invariance, while a shape-adaptive alignment module is designed to enable architecture-agnostic integration without re-training. We further derive a generalization bound based on conditional OT discrepancy, providing theoretical insight into FLOW’s robustness under distributional shifts. Extensive experiments across diverse rPPG benchmarks demonstrate that FLOW consistently improves cross-domain generalization while maintaining lightweight and modular deployment.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a09d0a91-b976-4b47-bac8-4f38b58ae527Builds on7
- PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference TransformerZitong Yu, Yuming Shen, Jingang Shi, Hengshuang Zhao et al.CVPR 2022 · 255 citations
- PhysLLM: Harnessing Large Language Models for Cross-Modal Remote Physiological SensingYiping Xie, Bo Zhao, Mingtong Dai, Jian-Ping Zhou et al.ICLR 2026 · 19 citations
- H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic ManipulationYijie Zhu, Rui Shao, Ziyang Liu, Jie He et al.AAAI 2026 · 5 citations
- EmoSym: A Symbiotic Framework for Unified Emotional Understanding and Generation via Latent ReasoningYijie Zhu, Yibo Lyu, Zitong Yu, Rui Shao et al.ACM MM 2025 · 3 citations
- rPPG-HiBa: Hierarchical Balanced Framework for Remote Physiological MeasurementYin Wang, Hao Lu, Ying-Cong Chen, Li Kuang et al.ACM MM 2024 · 2 citations
Related papers
- Neuron Structure Modeling for Generalizable Remote Physiological MeasurementHao Lu, Zitong Yu, Xuesong Niu, Yingcong ChenCVPR 2023
- Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution VideosJianwei Li, Zitong Yu, Jingang ShiAAAI 2023 · 65 citations
- Resolve Domain Conflicts for Generalizable Remote Physiological MeasurementWeiyu Sun, Xinyu Zhang, Hao Lu, Ying Chen et al.ACM MM 2023 · 15 citations
- To Remember, To Adapt, To Preempt: A Stable Continual Test-Time Adaptation Framework for Remote Physiological Measurement in Dynamic Domain ShiftsShuyang Chu, Jingang Shi, Xu Cheng, Haoyu Chen et al.ACM MM 2025 · 4 citations
- Remote Photoplethysmography in Real-World and Extreme Lighting ScenariosHang Shao, Lei Luo, Jianjun Qian, Mengkai Yan et al.CVPR 2025
