Secure Federated Correlation Test and Entropy Estimation
Qi Pang, Lun Wang, Shuai Wang, Wenting Zheng, Dawn Song
Abstract
We propose the first federated correlation test framework compatible with secure aggregation, namely FED-χ 2 . In our protocol, the statistical computations are recast as frequency moment estimation problems, where the clients collaboratively generate a shared projection matrix and then use stable projection to encode the local information in a compact vector. As such encodings can be linearly aggregated, secure aggregation can be applied to conceal the individual updates. We formally establish the security guarantee of FED-χ 2 by proving that only the minimum necessary information (i.e., the correlation statistics) is revealed to the server. We show that our protocol can be naturally extended to estimate other statistics that can be recast as frequency moment estimations. By accommodating Shannon'e Entropy in FED-χ 2 , we further propose the first secure federated entropy estimation protocol, FED-H. The evaluation results demonstrate that FED-χ 2 and FED-H achieve good performance with small client-side computation overhead in several real-world case studies.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Algorithmic Data Minimization for Machine Learning over Internet-of-Things Data StreamsTed Shaowang, Shinan Liu, Jonatas Marques, Nick Feamster et al.VLDB 2025
- Powerful and Theoretically Guaranteed Independence Testing on Heterogeneous Federated ClientsYiXin Ren, Hongquan Liu, Juncai Zhang, Yewei Xia et al.ICML 2026
Builds on8
- Practical Secure Aggregation for Privacy-Preserving Machine LearningKallista A. Bonawitz, Vladimir Ivanov, Ben Kreuter, Antonio Marcedone et al.CCS 2017 · 3,936 citations
- FetchSGD: Communication-Efficient Federated Learning with SketchingDaniel Rothchild, Ashwinee Panda, Enayat Ullah, Nikita Ivkin et al.ICML 2020 · 425 citations
- The Discrete Gaussian for Differential PrivacyClément L. Canonne, Gautam Kamath, Thomas SteinkeNeurIPS 2020 · 355 citations
- Addressing Class Imbalance in Federated LearningLixu Wang, Shichao Xu, Xiao Wang, Qi ZhuAAAI 2021 · 314 citations
- The Distributed Discrete Gaussian Mechanism for Federated Learning with Secure AggregationPeter Kairouz, Ziyu Liu, Thomas SteinkeICML 2021 · 291 citations
Related papers
- Private and Communication-Efficient Algorithms for Entropy EstimationGecia Bravo Hermsdorff, Róbert Busa-Fekete, Mohammad Ghavamzadeh, Andrés Muñoz Medina et al.NeurIPS 2022 · 3 citations
- Private Federated Frequency Estimation: Adapting to the Hardness of the InstanceJingfeng Wu, Wennan Zhu, Peter Kairouz, Vladimir BravermanNeurIPS 2023 · 2 citations
- FedAlign: Differentially Private Distribution Alignment for Non-IID Federated LearningPeng Wu, Jiapeng Zhang, Yingjie Song, Xiong Xiao et al.CVPR 2026
- The Fundamental Price of Secure Aggregation in Differentially Private Federated LearningWei-Ning Chen, Christopher A. Choquette-Choo, Peter Kairouz, Ananda Theertha SureshICML 2022 · 82 citations
- Accurate, Private, Secure, Federated U-statistics with Higher DegreeQuentin Sinh, Jan RamonICML 2026
