Non-stationary Experimental Design under Linear Trends
David Simchi-Levi, Chonghuan Wang, Zeyu Zheng
Abstract
Experimentation has been critical and increasingly popular across various domains, such as clinical trials and online platforms, due to its widely recognized benefits. One of the primary objectives of classical experiments is to estimate the average treatment effect (ATE) to inform future decision-making. However, in healthcare and many other settings, treatment effects may be non-stationary, meaning that they can change over time, rendering the traditional experimental design inadequate and the classical static ATE uninformative. In this work, we address the problem of non-stationary experimental design under linear trends by considering two objectives: estimating the dynamic treatment effect and minimizing welfare loss within the experiment. We propose an efficient design that can be customized for optimal estimation error rate, optimal regret rate, or the Pareto optimal trade-off between the two objectives. We establish information-theoretical lower bounds that highlight the inherent challenge in estimating dynamic treatment effects and minimizing welfare loss, and also statistically reveal the fundamental trade-off between them.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- The Pareto-optimal Trade-off between Regret and Statistical Inference in Linear Stochastic Bandits under Safety ConstraintsYuming Shao, Zhixuan FangICML 2026
- Estimation of Treatment Effects Under Nonstationarity via the Truncated Policy Gradient EstimatorRamesh Johari, Tianyi Peng, Wenqian XingICML 2026
Builds on12
- Inference for Batched BanditsKelly W. Zhang, Lucas Janson, Susan A. MurphyNeurIPS 2020 · 115 citations
- Restless-UCB, an Efficient and Low-complexity Algorithm for Online Restless BanditsSiwei Wang, Longbo Huang, John C. S. LuiNeurIPS 2020 · 58 citations
- Online Multi-Armed Bandits with Adaptive InferenceMaria Dimakopoulou, Zhimei Ren, Zhengyuan ZhouNeurIPS 2021 · 47 citations
- Adaptive Experimental Design with Temporal Interference: A Maximum Likelihood ApproachPeter W. Glynn, Ramesh Johari, Mohammad RasouliNeurIPS 2020 · 45 citations
- Contextual-Bandit Based Personalized Recommendation with Time-Varying User InterestsXiao Xu, Fang Dong, Yanghua Li, Shaojian He et al.AAAI 2020 · 41 citations
Related papers
- Optimal Treatment Allocation for Efficient Policy Evaluation in Sequential Decision MakingTing Li, Chengchun Shi, Jianing Wang, Fan Zhou et al.NeurIPS 2023 · 21 citations
- Privacy Preserving Adaptive Experiment DesignJiachun Li, Kaining Shi, David Simchi-LeviICML 2024 · 1 citation
- Modeling Covariate Transition for Efficient Estimation of Longitudinal Treatment Effects in Randomized ExperimentsNaoki Chihara, Tatsushi Oka, Yasuko Matsubara, Yasushi Sakurai et al.ICML 2026
- Active Adaptive Experimental Design for Treatment Effect Estimation with Covariate ChoiceMasahiro Kato, Akihiro Oga, Wataru Komatsubara, Ryo InokuchiICML 2024 · 12 citations
- Estimation of Bounds on Potential Outcomes For Decision MakingMaggie Makar, Fredrik D. Johansson, John V. Guttag, David A. SontagICML 2020 · 11 citations
