Fast Instrument Learning with Faster Rates
Ziyu Wang, Yuhao Zhou, Jun Zhu
Abstract
We investigate nonlinear instrumental variable (IV) regression given high-dimensional instruments. We propose a simple algorithm which combines kernelized IV methods and an arbitrary, adaptive regression algorithm, accessed as a black box. Our algorithm enjoys faster-rate convergence and adapts to the dimensionality of informative latent features, while avoiding an expensive minimax optimization procedure, which has been necessary to establish similar guarantees. It further brings the benefit of flexible machine learning models to quasi-Bayesian uncertainty quantification, likelihood-based model selection, and model averaging. Simulation studies demonstrate the competitive performance of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3017158a-94db-40b2-a9a8-815f1926172fCited by top-tier papers2
- Demystifying Spectral Feature Learning for Instrumental Variable RegressionDimitri Meunier, Antoine Moulin, Jakub Wornbard, Vladimir Kostic et al.NeurIPS 2025 · 5 citations
- Outcome-Aware Spectral Feature Learning for Instrumental Variable RegressionDimitri Meunier, Jakub Wornbard, Vladimir Kostic, Antoine Moulin et al.ICML 2026 · 2 citations
Builds on6
- On the Theory of Transfer Learning: The Importance of Task DiversityNilesh Tripuraneni, Michael I. Jordan, Chi JinNeurIPS 2020 · 263 citations
- Minimax Estimation of Conditional Moment ModelsNishanth Dikkala, Greg Lewis, Lester Mackey, Vasilis SyrgkanisNeurIPS 2020 · 125 citations
- Dual Instrumental Variable RegressionKrikamol Muandet, Arash Mehrjou, Si Kai Lee, Anant RajNeurIPS 2020 · 87 citations
- Learning Deep Features in Instrumental Variable RegressionLiyuan Xu, Yutian Chen, Siddarth Srinivasan, Nando de Freitas et al.ICLR 2021 · 85 citations
- Few-Shot Learning via Learning the Representation, ProvablySimon Shaolei Du, Wei Hu, Sham M. Kakade, Jason D. Lee et al.ICLR 2021 · 56 citations
Related papers
- Scalable Quasi-Bayesian Inference for Instrumental Variable RegressionZiyu Wang, Yuhao Zhou, Tongzheng Ren, Jun ZhuNeurIPS 2021 · 7 citations
- Valid Causal Inference with (Some) Invalid InstrumentsJason S. Hartford, Victor Veitch, Dhanya Sridhar, Kevin Leyton-BrownICML 2021 · 30 citations
- Nonparametric Instrumental Variable Regression through Stochastic Approximate GradientsYuri R. Fonseca, Caio Peixoto, Yuri F. SaporitoNeurIPS 2024 · 8 citations
- Sequential Underspecified Instrument Selection for Cause-Effect EstimationElisabeth Ailer, Jason S. Hartford, Niki KilbertusICML 2023 · 5 citations
- Optimality and Adaptivity of Deep Neural Features for Instrumental Variable RegressionJuno Kim, Dimitri Meunier, Arthur Gretton, Taiji Suzuki et al.ICLR 2025
