Decentralized Online Convex Optimization with Unknown Feedback Delays
Hao Qiu, Mengxiao Zhang, Juliette Achddou
摘要
Decentralized online convex optimization (D-OCO), where multiple agents within a network collaboratively learn optimal decisions in real-time, arises naturally in applications such as federated learning, sensor networks, and multi-agent control. In this paper, we study D-OCO under unknown, time-and agent-varying feedback delays. While recent work has addressed this problem (Nguyen et al., 2024) , existing algorithms assume prior knowledge of the total delay over agents and still suffer from suboptimal dependence on both the delay and network parameters. To overcome these limitations, we propose a novel algorithm that achieves an improved regret bound of , where T is the total horizon, d tot denotes the average total delay across agents, N is the number of agents, and 1 -σ 2 is the spectral gap of the network. Our approach builds upon recent advances in D-OCO (Wan et al., 2024a), but crucially incorporates an adaptive learning rate mechanism via a decentralized communication protocol. This enables each agent to estimate delays locally using a gossip-based strategy without the prior knowledge of the total delay. We further extend our framework to the strongly convex setting and derive a sharper regret bound of O N δmax ln T α , where α is the strong convexity parameter and δ max is the maximum number of missing observations averaged over agents. We also show that our upper bounds for both settings are tight up to logarithmic factors. Experimental results validate the effectiveness of our approach, showing improvements over existing benchmark algorithms.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper3
- Learning Adversarial Markov Decision Processes with Delayed FeedbackTal Lancewicki, Aviv Rosenberg, Yishay MansourAAAI 2022 · 被引用 40 次
- Adapting to Delays and Data in Adversarial Multi-Armed BanditsAndrás György, Pooria JoulaniICML 2021 · 被引用 35 次
- Exploiting Curvature in Online Convex Optimization with Delayed FeedbackHao Qiu, Emmanuel Esposito, Mengxiao ZhangICML 2025
相关 Paper
- Decentralized Online Convex Optimization with Efficient Communication: Improved Algorithm and Lower BoundsSifan Yang, Wenhao Yang, Wei Jiang, Lijun ZhangICML 2026 · 被引用 2 次
- Improved Regret for Bandit Convex Optimization with Delayed FeedbackYuanyu Wan, Chang Yao, Mingli Song, Lijun ZhangNeurIPS 2024 · 被引用 11 次
- Delay-Tolerant Constrained OCO with Application to Network Resource AllocationJuncheng Wang, Ben Liang, Min Dong, Gary Boudreau 等INFOCOM 2021 · 被引用 11 次
- Non-stationary Online Convex Optimization with Arbitrary DelaysYuanyu Wan, Chang Yao, Mingli Song, Lijun ZhangICML 2024 · 被引用 3 次
- Online Sequential Decision-Making with Unknown DelaysPing Wu, Heyan Huang, Zhengyang LiuWWW 2024 · 被引用 5 次
