GeoEvo: Identity-Aware Potential Game with Geometric Evolution for Personalized Multimodal Federated Learning
Chen Wang, Yongli Hu, Huajie Jiang, Kan Guo, Tengfei Liu, Junbin Gao, Yanfeng Sun, Baocai Yin
Abstract
We reconceptualize Personalized Multimodal Federated Learning (PMFL) by treating missing modalities as intrinsic structural identities that constrain each client to a distinct Riemannian submanifold, rather than as deficiencies to be compensated. To reconcile the tension between identity preservation and cross-client collaboration, we cast PMFL as an identity-aware potential game and seek a geometry-consistent equilibrium instead of a monolithic full-modality optimum. We propose GeoEvo, a federated approximate solver that combines curvature-adaptive Fisher descent with manifold-lifted evolutionary search: Natural Evolution Strategies for basin escape and Particle Swarm updates anchored to a server-broadcast Fréchet prototype for cross-client transfer. A monotone selection rule guarantees surrogate descent and an O(1/ √ T ) stationarity rate; controlled lift residuals further imply expected potential dissipation and, when vanishing, convergence toward first-order Nash equilibria. Empirically, GeoEvo improves personalization and robustness across diverse missing-modality patterns.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4ea7d9e0-8e03-4521-b1f7-20cae4c97d3fBuilds on18
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionWonjae Kim, Bokyung Son, Ildoo KimICML 2021 · 2,258 citations
- Personalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning ApproachAlireza Fallah, Aryan Mokhtari, Asuman E. OzdaglarNeurIPS 2020 · 1,354 citations
- Ditto: Fair and Robust Federated Learning Through PersonalizationTian Li, Shengyuan Hu, Ahmad Beirami, Virginia SmithICML 2021 · 1,313 citations
- Exploiting Shared Representations for Personalized Federated LearningLiam Collins, Hamed Hassani, Aryan Mokhtari, Sanjay ShakkottaiICML 2021 · 1,081 citations
Related papers
- Personalized Federated Learning with Moreau EnvelopesCanh T. Dinh, Nguyen Hoang Tran, Tuan Dung NguyenNeurIPS 2020 · 1,542 citations
- Federated Manifold Learning (FML): Tackling Domain Heterogeneity with Structural Knowledge TransferXutong Mu, Yanbiao Ma, Jia Shi, Xueli Geng et al.ICML 2026
- FedAPM: Federated Learning via ADMM with Partial Model PersonalizationShengkun Zhu, Feiteng Nie, Jinshan Zeng, Sheng Wang et al.KDD 2025 · 3 citations
- LAUA: Handling Missing Modalities and Unpaired Data in Multimodal Federated LearningYi Wei, Xiaokai Zhou, Shanshan Feng, Chuang Hu et al.KDD 2026
- Personalized Federated Learning with First Order Model OptimizationMichael Zhang, Karan Sapra, Sanja Fidler, Serena Yeung et al.ICLR 2021 · 414 citations
