Privacy Enhancement in Over-the-Air Federated Learning via Adaptive Receive Scaling
Faeze Moradi Kalarde, Ben Liang, Min Dong, Yahia A. Eldemerdash Ahmed, Ho Ting Cheng
摘要
In Federated Learning (FL) with over-the-air aggregation, the quality of the signal received at the server critically depends on the receive scaling factors. While a larger scaling factor can reduce the effective noise power and improve training performance, it also compromises the privacy of devices by reducing uncertainty. In this work, we aim to adaptively design the receive scaling factors across training rounds to balance the trade-off between training convergence and privacy in an FL system under dynamic channel conditions. We formulate a stochastic optimization problem that minimizes the overall Rényi differential privacy (RDP) leakage over the entire training process, subject to a long-term constraint that ensures convergence of the global loss function. Our problem depends on unknown future information, and we observe that standard Lyapunov optimization is not applicable. Thus, we develop a new online algorithm, termed AdaScale, based on a sequence of novel per-round problems that can be solved efficiently. We further derive upper bounds on the dynamic regret and constraint violation of AdaSacle, establishing that it achieves diminishing dynamic regret in terms of time-averaged RDP leakage while ensuring convergence of FL training to a stationary point. Numerical experiments on canonical classification tasks show that our approach effectively reduces RDP and DP leakages compared with state-of-the-art benchmarks without compromising learning performance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- Differentially Private Learning Needs Better Features (or Much More Data)Florian Tramèr, Dan BonehICLR 2021 · 被引用 325 次
- Understanding Gradient Clipping in Private SGD: A Geometric PerspectiveXiangyi Chen, Zhiwei Steven Wu, Mingyi HongNeurIPS 2020 · 被引用 254 次
- Tempered Sigmoid Activations for Deep Learning with Differential PrivacyNicolas Papernot, Abhradeep Thakurta, Shuang Song, Steve Chien 等AAAI 2021 · 被引用 210 次
- Rethinking gradient sparsification as total error minimizationAtal Narayan Sahu, Aritra Dutta, Ahmed M. Abdelmoniem, Trambak Banerjee 等NeurIPS 2021 · 被引用 85 次
相关 Paper
- Sketched Gaussian Mechanism for Private Federated LearningQiaobo Li, Zhijie Chen, Arindam BanerjeeNeurIPS 2025 · 被引用 2 次
- Differentially Private Learning with Adaptive ClippingGalen Andrew, Om Thakkar, Brendan McMahan, Swaroop RamaswamyNeurIPS 2021 · 被引用 425 次
- Noise-Aware Algorithm for Heterogeneous Differentially Private Federated LearningSaber Malekmohammadi, Yaoliang Yu, Yang CaoICML 2024 · 被引用 10 次
- Privacy-Aware Compression for Federated Learning Through Numerical Mechanism DesignChuan Guo, Kamalika Chaudhuri, Pierre Stock, Michael G. RabbatICML 2023 · 被引用 9 次
- Convergent Differential Privacy Analysis for General Federated LearningYan Sun, Qixin Zhang, Li Shen, Dacheng TaoICLR 2026
