Personalized Longitudinal Medical Report Generation via Temporally-Aware Federated Adaptation
He Zhu, Ren Togo, Takahiro Ogawa, Kenji Hirata, Minghui Tang, Takaaki Yoshimura, Hiroyuki Sugimori, Noriko Nishioka, Yukie Shimizu, Kohsuke Kudo, Miki Haseyama
Abstract
Automatic medical report generation from multimodal longitudinal imaging is crucial for clinical diagnosis but remains challenging due to privacy constraints and evolving disease dynamics. While federated learning (FL) enables decentralized model training without data sharing, its extension to longitudinal medical modeling remains underexplored. Existing FL approaches overlook temporal non-stationarity across visits and patient-specific heterogeneity, causing unstable optimization and degraded report quality.We introduce Federated Temporal Adaptation (FTA), a new FL setting for longitudinal medical report generation, and propose FedTAR, a framework combining parameter-efficient personalization and meta-learned temporal aggregation. FedTAR employs a metadata-conditioned LoRA module that generates patient-specific adapters from Gaussian-mixture embeddings and a residual temporal aggregation scheme that adaptively weights client updates via first-order MAML, ensuring stable and efficient optimization under temporal heterogeneity.Experiments on J-MID (1M exams) and MIMIC-CXR demonstrate consistent improvements in linguistic accuracy, temporal coherence, and cross-site generalization, establishing FedTAR as a robust, privacy-preserving paradigm for federated multimodal longitudinal modeling.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- Adaptive Federated OptimizationSashank J. Reddi, Zachary Charles, Manzil Zaheer, Zachary Garrett et al.ICLR 2021 · 1,917 citations
- Distributionally Robust Federated AveragingYuyang Deng, Mohammad Mahdi Kamani, Mehrdad MahdaviNeurIPS 2020 · 176 citations
- Perada: Parameter-Efficient Federated Learning Personalization with Generalization GuaranteesChulin Xie, De-An Huang, Wenda Chu, Daguang Xu et al.CVPR 2024 · 15 citations
- Medical Report Generation via Multimodal Spatio-Temporal FusionXin Mei, Rui Mao, Xiaoyan Cai, Libin Yang et al.ACM MM 2024 · 8 citations
Related papers
- UniFLoW: Universal Multi-Modal Federated LoRA Fine-Tuning Framework with Analytical Aggregationhaoyuan liang, Zhiyu Ye, Jielong Tang, Yang Yang et al.ICML 2026
- FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-TuningJieming Bian, Lei Wang, Letian Zhang, Jie XuICML 2026 · 1 citation
- HC-LLM: Historical-Constrained Large Language Models for Radiology Report GenerationTengfei Liu, Jiapu Wang, Yongli Hu, Mingjie Li et al.AAAI 2025 · 6 citations
- Shift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical SegmentationXingyue Zhao, Wenke Huang, Linghao Zhuang, Haoran Wu et al.ICML 2026
- Rethinking Radiology Report Generation: From Narrative Flow to Topic-Guided FindingsSheng Cheng, Devika SubramanianICLR 2026
