Multilingual Federated Low-Rank Adaptation for Collaborative Content Anomaly Detection across Multilingual Social Media Participants
Jiaxin Li, Geng Zhao, Xiaoci Zhang
摘要
Recently,the rapid development of multilingual social media platforms (SNS) exacerbates multilinguality challenges in SNS content anomaly detection due to data islands and linguistic imbalance. While federated learning (FL) and parameter-efficient fine-tuning (PEFT) offer potential solutions in most cases, when every client is multilingual, existing solutions struggle with multilingual heterogeneity: 1) entangled language-specific knowledge during aggregation, 2) noise from minority languages, and 3) unstable cross-platform collaboration. Based on the asymmetric nature of LoRA, we propose MuLA-F, a multilingual Federated LoRA introducing SVD-based language-specific disentanglement of LoRA blocks and a local orthogonal tuning strategy. Evaluations across 3 SNS content anomaly detection tasks demonstrate MuLA-F's superiority in multilingual performance while reducing multilingual knowledge conflicts and communication rounds.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Personalized Cross-Silo Federated Learning on Non-IID DataYutao Huang, Lingyang Chu, Zirui Zhou, Lanjun Wang 等AAAI 2021 · 被引用 816 次
- FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank AdaptationsZiyao Wang, Zheyu Shen, Yexiao He, Guoheng Sun 等NeurIPS 2024 · 被引用 227 次
- Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client ResourcesJiamu Bai, Daoyuan Chen, Bingchen Qian, Liuyi Yao 等NeurIPS 2024 · 被引用 178 次
- Improving LoRA in Privacy-preserving Federated LearningYoubang Sun, Zitao Li, Yaliang Li, Bolin DingICLR 2024 · 被引用 173 次
相关 Paper
- FedP²EFT: Federated Learning to Personalize PEFT for Multilingual LLMsRoyson Lee, Minyoung Kim, Fady Rezk, Rui Li 等AAAI 2026
- Tensor-Aggregated LoRA in Federated Fine-TuningZhixuan Li, Binqian Xu, Xiangbo Shu, Jiachao Zhang 等ICCV 2025 · 被引用 2 次
- FedPissa: Towards Federated Personalized Adaptation of Foundation Models via LoRA Subspace MappingWenwen He, Wenke Huang, Yi Liu, Jian Liang 等ICML 2026
- MTL-LoRA: Low-Rank Adaptation for Multi-Task LearningYaming Yang, Dilxat Muhtar, Yelong Shen, Yuefeng Zhan 等AAAI 2025 · 被引用 23 次
- MLAS-LoRA: Language-Aware Parameters Detection and LoRA-Based Knowledge Transfer for Multilingual Machine TranslationTianyu Dong, Bo Li, Jinsong Liu, Shaolin Zhu 等ACL 2025
