ICML2026
Robust Linear Dueling Bandits with Post-serving Context under Unknown Delays and Adversarial Corruptions
Youngmin Oh
Abstract
We study linear dueling bandits in volatile environments characterized by the simultaneous presence of post-serving contexts, delayed feedback, and adversarial corruption. Feedback is subject to unknown stochastic or adversarial delays and a cumulative corruption budget . To address these challenges, we propose RCDP-UCB, which integrates a learned approximator that predicts post-serving contexts from pre-serving information. It further employs an adaptive weighting strategy that clips feature vectors to mitigate the impact of corrupted and delayed observations simultaneously. Under standard regularity conditions and a parametric post-serving mapping, we rigorously establish that our algorithm is delay-regime-agnostic, achieving a regret upper bound of , where is the total feature dimension and encapsulates the delay complexity, scaling with under adversarial delays or under stochastic delays (: cumulative delay budget; : mean of sub-Gaussian delays). We further establish lower bounds that nearly match our upper bounds up to a factor for adversarial delays in the absence of post-serving contexts. Code is available at https://github.com/youngmin0oh/rcdp-public.