Resolve Domain Conflicts for Generalizable Remote Physiological Measurement
Weiyu Sun, Xinyu Zhang, Hao Lu, Ying Chen, Yun Ge, Xiaolin Huang, Jie Yuan, Yingcong Chen
摘要
Remote photoplethysmography (rPPG) technology has become increasingly popular due to its non-invasive monitoring of various physiological indicators, making it widely applicable in multimedia interaction, healthcare, and emotion analysis. Existing rPPG methods utilize multiple datasets for training to enhance the generalizability of models. However, they often overlook the underlying conflict issues across different datasets, such as (1) label conflict resulting from different phase delays between physiological signal labels and face videos at the instance level, and (2) attribute conflict stemming from distribution shifts caused by head movements, illumination changes, skin types, etc. To address this, we introduce the DOmain-HArmonious framework (DOHA). Specifically, we first propose a harmonious phase strategy to eliminate uncertain phase delays and preserve the temporal variation of physiological signals. Next, we design a harmonious hyperplane optimization that reduces irrelevant attribute shifts and encourages the model's optimization towards a global solution that fits more valid scenarios. Our experiments demonstrate that DOHA significantly improves the performance of existing methods under multiple protocols. Our code is available at https://github.com/SWY666/rPPG-DOHA.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- To Remember, To Adapt, To Preempt: A Stable Continual Test-Time Adaptation Framework for Remote Physiological Measurement in Dynamic Domain ShiftsShuyang Chu, Jingang Shi, Xu Cheng, Haoyu Chen 等ACM MM 2025 · 被引用 4 次
- Rhythmguassian: Repurposing Generalizable Gaussian Model for Remote Physiological MeasurementHao Lu, Yuting Zhang, Jiaqi Tang, Bowen Fu 等ICCV 2025 · 被引用 2 次
它引用的顶会 Paper14
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine 等NeurIPS 2020 · 被引用 2,261 次
- Sharpness-aware Minimization for Efficiently Improving GeneralizationPierre Foret, Ariel Kleiner, Hossein Mobahi, Behnam NeyshaburICLR 2021 · 被引用 1,861 次
- Out-of-Distribution Generalization via Risk Extrapolation (REx)David Krueger, Ethan Caballero, Jörn-Henrik Jacobsen, Amy Zhang 等ICML 2021 · 被引用 1,163 次
- Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals MeasurementXin Liu, Josh Fromm, Shwetak N. Patel, Daniel McDuffNeurIPS 2020 · 被引用 436 次
- Remote Heart Rate Measurement From Highly Compressed Facial Videos: An End-to-End Deep Learning Solution With Video EnhancementZitong Yu, Wei Peng, Xiaobai Li, Xiaopeng Hong 等ICCV 2019 · 被引用 324 次
相关 Paper
- rPPG-HiBa: Hierarchical Balanced Framework for Remote Physiological MeasurementYin Wang, Hao Lu, Ying-Cong Chen, Li Kuang 等ACM MM 2024 · 被引用 2 次
- FLOW: Feature-Level Optimal Warping for Generalized Remote Physiological Measurementbo zhao, Junzhe Cao, Dan Guo, Dongmin Huang 等CVPR 2026 · 被引用 2 次
- Neuron Structure Modeling for Generalizable Remote Physiological MeasurementHao Lu, Zitong Yu, Xuesong Niu, Yingcong ChenCVPR 2023
- Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution VideosJianwei Li, Zitong Yu, Jingang ShiAAAI 2023 · 被引用 65 次
- Dual-bridging with Adversarial Noise Generation for Domain Adaptive rPPG EstimationJingda Du, Siqi Liu, Bochao Zhang, Pong C. YuenCVPR 2023
