GeoEvo: Identity-Aware Potential Game with Geometric Evolution for Personalized Multimodal Federated Learning
Chen Wang, Yongli Hu, Huajie Jiang, Kan Guo, Tengfei Liu, Junbin Gao, Yanfeng Sun, Baocai Yin
摘要
We reconceptualize Personalized Multimodal Federated Learning (PMFL) by treating missing modalities as intrinsic structural identities that constrain each client to a distinct Riemannian submanifold, rather than as deficiencies to be compensated. To reconcile the tension between identity preservation and cross-client collaboration, we cast PMFL as an identity-aware potential game and seek a geometry-consistent equilibrium instead of a monolithic full-modality optimum. We propose GeoEvo, a federated approximate solver that combines curvature-adaptive Fisher descent with manifold-lifted evolutionary search: Natural Evolution Strategies for basin escape and Particle Swarm updates anchored to a server-broadcast Fréchet prototype for cross-client transfer. A monotone selection rule guarantees surrogate descent and an O(1/ √ T ) stationarity rate; controlled lift residuals further imply expected potential dissipation and, when vanishing, convergence toward first-order Nash equilibria. Empirically, GeoEvo improves personalization and robustness across diverse missing-modality patterns.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi 等ICML 2020 · 被引用 3,875 次
- ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionWonjae Kim, Bokyung Son, Ildoo KimICML 2021 · 被引用 2,258 次
- Personalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning ApproachAlireza Fallah, Aryan Mokhtari, Asuman E. OzdaglarNeurIPS 2020 · 被引用 1,354 次
- Ditto: Fair and Robust Federated Learning Through PersonalizationTian Li, Shengyuan Hu, Ahmad Beirami, Virginia SmithICML 2021 · 被引用 1,313 次
- Exploiting Shared Representations for Personalized Federated LearningLiam Collins, Hamed Hassani, Aryan Mokhtari, Sanjay ShakkottaiICML 2021 · 被引用 1,081 次
相关 Paper
- Personalized Federated Learning with Moreau EnvelopesCanh T. Dinh, Nguyen Hoang Tran, Tuan Dung NguyenNeurIPS 2020 · 被引用 1,542 次
- Federated Manifold Learning (FML): Tackling Domain Heterogeneity with Structural Knowledge TransferXutong Mu, Yanbiao Ma, Jia Shi, Xueli Geng 等ICML 2026
- FedAPM: Federated Learning via ADMM with Partial Model PersonalizationShengkun Zhu, Feiteng Nie, Jinshan Zeng, Sheng Wang 等KDD 2025 · 被引用 3 次
- LAUA: Handling Missing Modalities and Unpaired Data in Multimodal Federated LearningYi Wei, Xiaokai Zhou, Shanshan Feng, Chuang Hu 等KDD 2026
- Personalized Federated Learning with First Order Model OptimizationMichael Zhang, Karan Sapra, Sanja Fidler, Serena Yeung 等ICLR 2021 · 被引用 414 次
