Multilingual Federated Low-Rank Adaptation for Collaborative Content Anomaly Detection across Multilingual Social Media Participants
Jiaxin Li, Geng Zhao, Xiaoci Zhang
Abstract
Recently,the rapid development of multilingual social media platforms (SNS) exacerbates multilinguality challenges in SNS content anomaly detection due to data islands and linguistic imbalance. While federated learning (FL) and parameter-efficient fine-tuning (PEFT) offer potential solutions in most cases, when every client is multilingual, existing solutions struggle with multilingual heterogeneity: 1) entangled language-specific knowledge during aggregation, 2) noise from minority languages, and 3) unstable cross-platform collaboration. Based on the asymmetric nature of LoRA, we propose MuLA-F, a multilingual Federated LoRA introducing SVD-based language-specific disentanglement of LoRA blocks and a local orthogonal tuning strategy. Evaluations across 3 SNS content anomaly detection tasks demonstrate MuLA-F's superiority in multilingual performance while reducing multilingual knowledge conflicts and communication rounds.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on17
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Personalized Cross-Silo Federated Learning on Non-IID DataYutao Huang, Lingyang Chu, Zirui Zhou, Lanjun Wang et al.AAAI 2021 · 816 citations
- FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank AdaptationsZiyao Wang, Zheyu Shen, Yexiao He, Guoheng Sun et al.NeurIPS 2024 · 227 citations
- Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client ResourcesJiamu Bai, Daoyuan Chen, Bingchen Qian, Liuyi Yao et al.NeurIPS 2024 · 178 citations
- Improving LoRA in Privacy-preserving Federated LearningYoubang Sun, Zitao Li, Yaliang Li, Bolin DingICLR 2024 · 173 citations
Related papers
- FedP²EFT: Federated Learning to Personalize PEFT for Multilingual LLMsRoyson Lee, Minyoung Kim, Fady Rezk, Rui Li et al.AAAI 2026
- Tensor-Aggregated LoRA in Federated Fine-TuningZhixuan Li, Binqian Xu, Xiangbo Shu, Jiachao Zhang et al.ICCV 2025 · 2 citations
- FedPissa: Towards Federated Personalized Adaptation of Foundation Models via LoRA Subspace MappingWenwen He, Wenke Huang, Yi Liu, Jian Liang et al.ICML 2026
- MTL-LoRA: Low-Rank Adaptation for Multi-Task LearningYaming Yang, Dilxat Muhtar, Yelong Shen, Yuefeng Zhan et al.AAAI 2025 · 23 citations
- MLAS-LoRA: Language-Aware Parameters Detection and LoRA-Based Knowledge Transfer for Multilingual Machine TranslationTianyu Dong, Bo Li, Jinsong Liu, Shaolin Zhu et al.ACL 2025
