ICML2026

Robust Linear Dueling Bandits with Post-serving Context under Unknown Delays and Adversarial Corruptions

Youngmin Oh

摘要

We study linear dueling bandits in volatile environments characterized by the simultaneous presence of post-serving contexts, delayed feedback, and adversarial corruption. Feedback is subject to unknown stochastic or adversarial delays and a cumulative corruption budget C\mathcal{C}. To address these challenges, we propose RCDP-UCB, which integrates a learned approximator that predicts post-serving contexts from pre-serving information. It further employs an adaptive weighting strategy that clips feature vectors to mitigate the impact of corrupted and delayed observations simultaneously. Under standard regularity conditions and a parametric post-serving mapping, we rigorously establish that our algorithm is delay-regime-agnostic, achieving a regret upper bound of O~(d(T+C+D))\widetilde{\mathcal{O}}(d(\sqrt{T} + \mathcal{C} + \mathcal{D})), where dd is the total feature dimension and D\mathcal{D} encapsulates the delay complexity, scaling with Λ\sqrt{\Lambda} under adversarial delays or μτ\mu_{\tau} under stochastic delays (Λ\Lambda: cumulative delay budget; μτ\mu_{\tau}: mean of sub-Gaussian delays). We further establish lower bounds that nearly match our upper bounds up to a d\sqrt{d} factor for adversarial delays in the absence of post-serving contexts. Code is available at https://github.com/youngmin0oh/rcdp-public.