Decentralized Online Convex Optimization with Unknown Feedback Delays
Hao Qiu, Mengxiao Zhang, Juliette Achddou
Abstract
Decentralized online convex optimization (D-OCO), where multiple agents within a network collaboratively learn optimal decisions in real-time, arises naturally in applications such as federated learning, sensor networks, and multi-agent control. In this paper, we study D-OCO under unknown, time-and agent-varying feedback delays. While recent work has addressed this problem (Nguyen et al., 2024) , existing algorithms assume prior knowledge of the total delay over agents and still suffer from suboptimal dependence on both the delay and network parameters. To overcome these limitations, we propose a novel algorithm that achieves an improved regret bound of , where T is the total horizon, d tot denotes the average total delay across agents, N is the number of agents, and 1 -σ 2 is the spectral gap of the network. Our approach builds upon recent advances in D-OCO (Wan et al., 2024a), but crucially incorporates an adaptive learning rate mechanism via a decentralized communication protocol. This enables each agent to estimate delays locally using a gossip-based strategy without the prior knowledge of the total delay. We further extend our framework to the strongly convex setting and derive a sharper regret bound of O N δmax ln T α , where α is the strong convexity parameter and δ max is the maximum number of missing observations averaged over agents. We also show that our upper bounds for both settings are tight up to logarithmic factors. Experimental results validate the effectiveness of our approach, showing improvements over existing benchmark algorithms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c19d0b7b-67d2-48bf-a92e-87204bc2f6c6Builds on3
- Learning Adversarial Markov Decision Processes with Delayed FeedbackTal Lancewicki, Aviv Rosenberg, Yishay MansourAAAI 2022 · 40 citations
- Adapting to Delays and Data in Adversarial Multi-Armed BanditsAndrás György, Pooria JoulaniICML 2021 · 35 citations
- Exploiting Curvature in Online Convex Optimization with Delayed FeedbackHao Qiu, Emmanuel Esposito, Mengxiao ZhangICML 2025
Related papers
- Decentralized Online Convex Optimization with Efficient Communication: Improved Algorithm and Lower BoundsSifan Yang, Wenhao Yang, Wei Jiang, Lijun ZhangICML 2026 · 2 citations
- Improved Regret for Bandit Convex Optimization with Delayed FeedbackYuanyu Wan, Chang Yao, Mingli Song, Lijun ZhangNeurIPS 2024 · 11 citations
- Delay-Tolerant Constrained OCO with Application to Network Resource AllocationJuncheng Wang, Ben Liang, Min Dong, Gary Boudreau et al.INFOCOM 2021 · 11 citations
- Non-stationary Online Convex Optimization with Arbitrary DelaysYuanyu Wan, Chang Yao, Mingli Song, Lijun ZhangICML 2024 · 3 citations
- Online Sequential Decision-Making with Unknown DelaysPing Wu, Heyan Huang, Zhengyang LiuWWW 2024 · 5 citations
