Distributionally Robust Policy Evaluation and Learning for Continuous Treatment with Observational Data
Cheuk Hang Leung, Yiyan Huang, Yijun Li, Qi Wu
Abstract
Using offline observational data for policy evaluation and learning allows decision-makers to evaluate and learn a policy that connects characteristics and interventions. Most existing literature has focused on either discrete treatment spaces or assumed no difference in the distributions between the policy-learning and policy-deployed environments. These restrict applications in many real-world scenarios where distribution shifts are present with continuous treatment. To overcome these challenges, this paper focuses on developing a distributionally robust policy under a continuous treatment setting. The proposed distributionally robust estimators are established using the Inverse Probability Weighting (IPW) method extended from the discrete one for policy evaluation and learning under continuous treatments. Specifically, we introduce a kernel function into the proposed IPW estimator to mitigate the exclusion of observations that can occur in the standard IPW method to continuous treatments. We then provide finite-sample analysis that guarantees the convergence of the proposed distributionally robust policy evaluation and learning estimators. The comprehensive experiments further verify the effectiveness of our approach when distribution shifts are present.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2a110e99-dbd5-4eda-8fdb-d4df5f0d65d8Builds on7
- Learning Counterfactual Representations for Estimating Individual Dose-Response CurvesPatrick Schwab, Lorenz Linhardt, Stefan Bauer, Joachim M. Buhmann et al.AAAI 2020 · 159 citations
- Estimating the Effects of Continuous-valued Interventions using Generative Adversarial NetworksIoana Bica, James Jordon, Mihaela van der SchaarNeurIPS 2020 · 137 citations
- Distributionally Robust Counterfactual Risk MinimizationLouis Faury, Ugo Tanielian, Elvis Dohmatob, Elena Smirnova et al.AAAI 2020 · 48 citations
- Doubly Robust Distributionally Robust Off-Policy Evaluation and LearningNathan Kallus, Xiaojie Mao, Kaiwen Wang, Zhengyuan ZhouICML 2022 · 39 citations
- End-to-End Balancing for Causal Continuous Treatment-Effect EstimationMohammad Taha Bahadori, Eric Tchetgen Tchetgen, David HeckermanICML 2022 · 15 citations
Related papers
- Doubly Robust Distributionally Robust Offline Contextual PricingMin Xu, Xinyi Yin, Yunfan Zhang, Yuxuan Han et al.ICML 2026 · 15 citations
- Distributionally Robust Policy Evaluation and Learning in Offline Contextual BanditsNian Si, Fan Zhang, Zhengyuan Zhou, Jose H. BlanchetICML 2020 · 59 citations
- Doubly Robust Off-Policy Value and Gradient Estimation for Deterministic PoliciesNathan Kallus, Masatoshi UeharaNeurIPS 2020 · 16 citations
- Factored DRO: Factored Distributionally Robust Policies for Contextual BanditsTong Mu, Yash Chandak, Tatsunori B. Hashimoto, Emma BrunskillNeurIPS 2022 · 8 citations
- Off-Policy Evaluation and Learning for External Validity under a Covariate ShiftMasatoshi Uehara, Masahiro Kato, Shota YasuiNeurIPS 2020 · 60 citations
