ICML2026
GeoEvo: Identity-Aware Potential Game with Geometric Evolution for Personalized Multimodal Federated Learning
Chen Wang, Yongli Hu, Huajie Jiang, Kan Guo, Tengfei Liu, Junbin Gao, Yanfeng Sun, Baocai Yin
摘要
We reconceptualize Personalized Multimodal Federated Learning (PMFL) by treating missing modalities as intrinsic structural identities that constrain each client to a distinct Riemannian submanifold, rather than as deficiencies to be compensated. To reconcile the tension between identity preservation and cross-client collaboration, we cast PMFL as an identity-aware potential game and seek a geometry-consistent equilibrium instead of a monolithic full-modality optimum. We propose GeoEvo, a federated approximate solver that combines curvature-adaptive Fisher descent with manifold-lifted evolutionary search: Natural Evolution Strategies for basin escape, and Particle Swarm updates anchored to a server-broadcast Fréchet prototype for cross-client transfer. A monotone acceptance rule drives per-step potential dissipation, yielding an stationarity rate and convergence toward first-order Nash equilibria in non-convex regimes. Empirically, GeoEvo improves personalization and robustness across diverse modality-missing patterns.