Robust Sequential Experimental Design for A/B Testing
Qianglin Wen, Xiangkun Wu, Chengchun Shi, Ting Li, Niansheng Tang, Yingying Zhang, Hongtu Zhu
2026年份
摘要
Experimental design has emerged as a powerful approach for improving the sample efficiency of A/B testing, yet existing designs rely critically on correctly specified models. We study robust sequential experimental design under model misspecification and develop a unified framework that covers both contextual bandit and dynamic settings. Theoretically, we prove that our design bounds the worst-case mean squared error of the estimated treatment effect. Empirically, we demonstrate the effectiveness of the proposed approach using synthetic and real-world datasets from a leading technology company.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Markovian Interference in ExperimentsVivek F. Farias, Andrew A. Li, Tianyi Peng, Andrew ZhengNeurIPS 2022 · 被引用 52 次
- Adaptive Experimental Design with Temporal Interference: A Maximum Likelihood ApproachPeter W. Glynn, Ramesh Johari, Mohammad RasouliNeurIPS 2020 · 被引用 45 次
- An Instrumental Variable Approach to Confounded Off-Policy EvaluationYang Xu, Jin Zhu, Chengchun Shi, Shikai Luo 等ICML 2023 · 被引用 24 次
- Optimal Treatment Allocation for Efficient Policy Evaluation in Sequential Decision MakingTing Li, Chengchun Shi, Jianing Wang, Fan Zhou 等NeurIPS 2023 · 被引用 21 次
- A/B Testing in Network Data with Covariate-Adaptive RandomizationJialu Wang, Ping Li, Feifang HuICML 2023 · 被引用 6 次
相关 Paper
- Non-stationary Experimental Design under Linear TrendsDavid Simchi-Levi, Chonghuan Wang, Zeyu ZhengNeurIPS 2023 · 被引用 6 次
- Integrating Inference and Experimental Design for Contextual Behavioral Model LearningGongtao Zhou, Haoran YuAAAI 2025
- Post-Contextual-Bandit InferenceAurélien Bibaut, Maria Dimakopoulou, Nathan Kallus, Antoine Chambaz 等NeurIPS 2021 · 被引用 58 次
- Robust Pricing in Dynamic Mechanism DesignYuan Deng, Sébastien Lahaie, Vahab S. MirrokniICML 2020 · 被引用 12 次
- Beyond Basic A/B Testing: Improving Statistical Efficiency for Business GrowthChangshuai Wei, Phuc Nguyen, Benjamin Zelditch, Joyce ChenKDD 2026 · 被引用 1 次
