Geometry-Aware Instrumental Variable Regression
Heiner Kremer, Bernhard Schölkopf
Abstract
Instrumental variable (IV) regression can be approached through its formulation in terms of conditional moment restrictions (CMR). Building on variants of the generalized method of moments, most CMR estimators are implicitly based on approximating the population data distribution via reweightings of the empirical sample. While for large sample sizes, in the independent identically distributed (IID) setting, reweightings can provide sufficient flexibility, they might fail to capture the relevant information in presence of corrupted data or data prone to adversarial attacks. To address these shortcomings, we propose the Sinkhorn Method of Moments, an optimal transport-based IV estimator that takes into account the geometry of the data manifold through data-derivative information. We provide a simple plug-and-play implementation of our method that performs on par with related estimators in standard settings but improves robustness against data corruption and adversarial attacks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- Minimax Estimation of Conditional Moment ModelsNishanth Dikkala, Greg Lewis, Lester Mackey, Vasilis SyrgkanisNeurIPS 2020 · 125 citations
- Dual Instrumental Variable RegressionKrikamol Muandet, Arash Mehrjou, Si Kai Lee, Anant RajNeurIPS 2020 · 87 citations
- Learning Deep Features in Instrumental Variable RegressionLiyuan Xu, Yutian Chen, Siddarth Srinivasan, Nando de Freitas et al.ICLR 2021 · 85 citations
- Exploiting Independent Instruments: Identification and Distribution GeneralizationSorawit Saengkyongam, Leonard Henckel, Niklas Pfister, Jonas PetersICML 2022 · 19 citations
- Functional Generalized Empirical Likelihood Estimation for Conditional Moment RestrictionsHeiner Kremer, Jia-Jie Zhu, Krikamol Muandet, Bernhard SchölkopfICML 2022 · 9 citations
Related papers
- Exploiting Geometry for Treatment Effect Estimation via Optimal TransportYuguang Yan, Zeqin Yang, Weilin Chen, Ruichu Cai et al.AAAI 2024 · 4 citations
- Robust Generalized Method of Moments: A Finite Sample ViewpointDhruv Rohatgi, Vasilis SyrgkanisNeurIPS 2022 · 3 citations
- Don't Generate Me: Training Differentially Private Generative Models with Sinkhorn DivergenceTianshi Cao, Alex Bie, Arash Vahdat, Sanja Fidler et al.NeurIPS 2021 · 88 citations
- Regularized Optimal Transport is Ground Cost AdversarialFrançois-Pierre Paty, Marco CuturiICML 2020 · 33 citations
- Sinkhorn Treatment Effects: A Causal Optimal Transport MeasureMedha Agarwal, Alex LuedtkeICML 2026
