Federated Learning of Quantile Inference under Local Differential Privacy
Leheng Cai, Qirui Hu, Shuyuan Wu
Abstract
In this paper, we investigate federated learning for quantile inference under local differential privacy (LDP). We propose an estimator based on local stochastic gradient descent (SGD), whose local gradients are perturbed via a randomized mechanism with global parameters, making the procedure tolerant of communication and storage constraints without compromising statistical efficiency. Although the quantile loss and its corresponding gradient do not satisfy standard smoothness conditions typically assumed in existing literature, we establish asymptotic normality for our estimator as well as a functional central limit theorem. The proposed method accommodates data heterogeneity and allows each server to operate with an individual privacy budget. Furthermore, we construct confidence intervals for the target value through a self‐normalization approach, thereby circumventing the need to estimate additional nuisance parameters. Extensive numerical experiments and real data application validate the theoretical guarantees of the proposed methodology.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e1642eb3-9021-4b2d-9a33-18a0f6a83aa8Cited by top-tier papers3
- Time-uniform and Asymptotic Confidence Sequence of Quantile under Local Differential PrivacyLeheng Cai, Qirui Hu, Juntao Sun, Shuyuan WuNeurIPS 2025 · 4 citations
- Censoring with Plausible Deniability: Asymmetric Local Privacy for Multi-Category CDF EstimationQirui Hu, Yi LiuICML 2026
- Privacy-Aware Data Integration for Enhanced Quantile Inference under HeterogeneityLeheng Cai, Qirui Hu, Shuyuan WuICML 2026
Builds on5
- Instance-optimal Mean Estimation Under Differential PrivacyZiyue Huang, Yuting Liang, Ke YiNeurIPS 2021 · 74 citations
- Online Local Differential Private Quantile Inference via Self-normalizationYi Liu, Qirui Hu, Lei Ding, Linglong KongICML 2023 · 7 citations
- Differentially Private QuantilesJennifer Gillenwater, Matthew Joseph, Alex KuleszaICML 2021 · 2 citations
- Private Federated Learning Without a Trusted Server: Optimal Algorithms for Convex LossesAndrew Lowy, Meisam RazaviyaynICLR 2023 · 2 citations
- Does Worst-Performing Agent Lead the Pack? Analyzing Agent Dynamics in Unified Distributed SGDJie Hu, Yi-Ting Ma, Do Young EunNeurIPS 2024 · 2 citations
Related papers
- One-Shot Weighted Ensemble Estimation for Federated Quantile Regression: Optimal Statistical Guarantees under Heterogeneous Structured DataGuang Yang, Bo Pan, Chengdi Lian, Xingcai Zhou et al.ICML 2026
- Answering Federated Range Queries with Local Differential PrivacyYuemin Zhang, Qingqing Ye, Junxu Liu, Wei DongICDE 2026
- Differentially Private Learning with Adaptive ClippingGalen Andrew, Om Thakkar, Brendan McMahan, Swaroop RamaswamyNeurIPS 2021 · 425 citations
- Piquant: Private Quantile Estimation in the Two-Server ModelHannah Keller, Jacob Imola, Fabrizio Boninsegna, Rasmus Pagh et al.CCS 2026
- Topological Federated Clustering via Gravitational Potential Fields Under Local Differential PrivacyYunbo Long, Jiaquan Zhang, Xi Chen, Alexandra BrintrupAAAI 2026 · 2 citations
