FLOW: Feature-Level Optimal Warping for Generalized Remote Physiological Measurement
bo zhao, Junzhe Cao, Dan Guo, Dongmin Huang, Wenjin Wang, Tao Tan, Yue Sun, Zitong YU
摘要
Remote photoplethysmography (rPPG) enables non-contact physiological measurement from facial videos but often suffers from severe performance degradation under domain shifts. Traditional STMap-based methods rely on predefined spatio-temporal representations that offer engineered robustness but discard fine-grained temporal cues. In contrast, end-to-end rPPG models directly learn hierarchical features from raw videos, capturing richer physiological patterns yet remaining highly sensitive to variations in illumination, motion, and camera sensors. To address these challenges, we propose FLOW (Feature-Level Optimal Warping), an Optimal Transport (OT)–driven and plug-and-play framework for multi-source domain generalization in rPPG measurement.FLOW formulates domain shifts as structured Optimal Transport problems and performs feature-level warping to align multiple source domains in a shared latent space. Specifically, a dual-consistency regularization is proposed to enforce both frequency fidelity and mapping invariance, while a shape-adaptive alignment module is designed to enable architecture-agnostic integration without re-training. We further derive a generalization bound based on conditional OT discrepancy, providing theoretical insight into FLOW’s robustness under distributional shifts. Extensive experiments across diverse rPPG benchmarks demonstrate that FLOW consistently improves cross-domain generalization while maintaining lightweight and modular deployment.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference TransformerZitong Yu, Yuming Shen, Jingang Shi, Hengshuang Zhao 等CVPR 2022 · 被引用 255 次
- PhysLLM: Harnessing Large Language Models for Cross-Modal Remote Physiological SensingYiping Xie, Bo Zhao, Mingtong Dai, Jian-Ping Zhou 等ICLR 2026 · 被引用 19 次
- H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic ManipulationYijie Zhu, Rui Shao, Ziyang Liu, Jie He 等AAAI 2026 · 被引用 5 次
- EmoSym: A Symbiotic Framework for Unified Emotional Understanding and Generation via Latent ReasoningYijie Zhu, Yibo Lyu, Zitong Yu, Rui Shao 等ACM MM 2025 · 被引用 3 次
- rPPG-HiBa: Hierarchical Balanced Framework for Remote Physiological MeasurementYin Wang, Hao Lu, Ying-Cong Chen, Li Kuang 等ACM MM 2024 · 被引用 2 次
相关 Paper
- Neuron Structure Modeling for Generalizable Remote Physiological MeasurementHao Lu, Zitong Yu, Xuesong Niu, Yingcong ChenCVPR 2023
- Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution VideosJianwei Li, Zitong Yu, Jingang ShiAAAI 2023 · 被引用 65 次
- Resolve Domain Conflicts for Generalizable Remote Physiological MeasurementWeiyu Sun, Xinyu Zhang, Hao Lu, Ying Chen 等ACM MM 2023 · 被引用 15 次
- To Remember, To Adapt, To Preempt: A Stable Continual Test-Time Adaptation Framework for Remote Physiological Measurement in Dynamic Domain ShiftsShuyang Chu, Jingang Shi, Xu Cheng, Haoyu Chen 等ACM MM 2025 · 被引用 4 次
- Remote Photoplethysmography in Real-World and Extreme Lighting ScenariosHang Shao, Lei Luo, Jianjun Qian, Mengkai Yan 等CVPR 2025
