The Hidden Risk: Membership Inference Attacks on Multimodal Federated Learning via Modality Imbalance
Chang Ma, Jun Li, Kang Wei, Yipeng Zhou, Ming Ding, Yiyang Ni
Abstract
Federated learning (FL) faces significant challenges from modality heterogeneity, which has motivated multimodal federated learning (MFL) to leverage complementary modalities across decentralized clients for improved performance. However, modality imbalance introduces a new attack surface, making MFL more vulnerable to membership inference attacks (MIAs), an issue that remains largely unexplored. In this work, we present the first systematic study of MIAs against MFL and propose a modality-aware attack framework. We show that multimodal models are inherently more susceptible to MIAs due to heterogeneous modality contributions, and existing attacks are suboptimal as they treat multimodal parameters as a whole. By performing MIAs on individual modalities, we find that (i) attacking the dominant modality achieves comparable accuracy with lower overhead, and (ii) different modalities expose distinct membership patterns. To identify members with different patterns, we propose a modality-aware framework that exploits cross-modal performance gaps to adaptively select attack modalities and calibrate inference results. Experiments on three datasets show our approach outperforms baselines across multiple metrics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e256642a-2e2c-42b1-b6bd-23a78b3bba76Builds on12
- Membership Inference Attacks Against Machine Learning ModelsReza Shokri, Marco Stronati, Congzheng Song, Vitaly ShmatikovS&P 2017 · 5,137 citations
- Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated LearningMilad Nasr, Reza Shokri, Amir HoumansadrS&P 2019 · 1,778 citations
- Machine Learning with Membership Privacy using Adversarial RegularizationMilad Nasr, Reza Shokri, Amir HoumansadrCCS 2018 · 543 citations
- Balanced Multimodal Learning via On-the-fly Gradient ModulationXiaokang Peng, Yake Wei, Andong Deng, Dong Wang et al.CVPR 2022 · 264 citations
- On the Importance of Difficulty Calibration in Membership Inference AttacksLauren Watson, Chuan Guo, Graham Cormode, Alexandre SablayrollesICLR 2022 · 189 citations
Related papers
- FedMIA: An Effective Membership Inference Attack Exploiting "All for One" Principle in Federated LearningGongxi Zhu, Donghao Li, Hanlin Gu, Yuan Yao et al.CVPR 2025
- Enhancing Privacy in Multimodal Federated Learning with Information TheoryTianzhe Xiao, Yichen Li, Yining Qi, Yi Liu et al.NeurIPS 2025 · 2 citations
- A Unified Defense Framework Against Membership Inference in Federated Learning via Distillation and Contribution-Aware AggregationLiwei Zhang, Linghui Li, Xiaotian Si, Ziduo Guo et al.NDSS 2026 · 1 citation
- MI: Multi-modal Models Membership InferencePingyi Hu, Zihan Wang, Ruoxi Sun, Hu Wang et al.NeurIPS 2022 · 39 citations
- FedAFD: Multimodal Federated Learning via Adversarial Fusion and DistillationMin Tan, Junchao Ma, Yinfu FENG, Jiajun Ding et al.CVPR 2026 · 1 citation
