FusionPhys: A Flexible Framework for Fusing Complementary Sensing Modalities in Remote Physiological Measurement

Remote physiological measurement using visible light cameras has emerged as a powerful tool for non-contact health monitoring, yet its reliability degrades under challenging conditions such as low-light environments or diverse skin tones. These limitations have motivated the exploration of alternative sensing modalities, such as nearinfrared sensors and radar systems, which offer complementary physiological information through distinct sensing principles. While these modalities provide valuable information, existing methods fail to holistically integrate these heterogeneous data. Our key insight is that while visible light, near-infrared, and radar operate on distinct physical principles, they all capture temporally dynamic physiological signatures that can be represented as time-varying signals reflecting underlying physiological processes. Based on this insight, we propose FusionPhys, a novel framework that implements an adaptive integration mechanism to refine physiological information across complementary modalities. We further introduce a sub-modality decomposition technique that extends fusion principles to singlemodality videos. Extensive experiments across five datasets demonstrate that FusionPhys achieves superior performance in diverse sensing configurations, representing a significant advancement toward more reliable and versatile remote physiological measurement systems. The code is available at: https://github.com/chh-ying/fusionphys.