Outcome-Aware Spectral Feature Learning for Instrumental Variable Regression
Dimitri Meunier, Jakub Wornbard, Vladimir Kostic, Antoine Moulin, Alek Fröhlich, Karim Lounici, Massimiliano Pontil, Arthur Gretton
Abstract
We address the problem of causal effect estimation in the presence of hidden confounders using nonparametric instrumental variable (IV) regression. An established approach is to use estimators based on learned spectral features, that is, features spanning the top singular subspaces of the operator linking treatments to instruments. While powerful, such features are agnostic to the outcome variable. Consequently, the method can fail when the true causal function is poorly represented by these dominant singular functions. To mitigate this, we introduce Augmented Spectral Feature Learning, a framework that makes the feature-learning process outcome-aware. Our method learns features by minimizing a novel contrastive loss derived from an augmented operator that incorporates information from the outcome. By learning these task-specific features, our approach remains effective even in the presence of spectral misalignment. We provide a theoretical analysis of this framework and validate our approach on challenging benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1c0a7199-6ef8-4875-9185-76658f33e902Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Neural Networks Fail to Learn Periodic Functions and How to Fix ItLiu Ziyin, Tilman Hartwig, Masahito UedaNeurIPS 2020 · 249 citations
- Minimax Estimation of Conditional Moment ModelsNishanth Dikkala, Greg Lewis, Lester Mackey, Vasilis SyrgkanisNeurIPS 2020 · 125 citations
- Learning Deep Features in Instrumental Variable RegressionLiyuan Xu, Yutian Chen, Siddarth Srinivasan, Nando de Freitas et al.ICLR 2021 · 85 citations
- Deep Proxy Causal Learning and its Application to Confounded Bandit Policy EvaluationLiyuan Xu, Heishiro Kanagawa, Arthur GrettonNeurIPS 2021 · 52 citations
- Provably Efficient Neural Estimation of Structural Equation Models: An Adversarial ApproachLuofeng Liao, You-Lin Chen, Zhuoran Yang, Bo Dai et al.NeurIPS 2020 · 40 citations
Related papers
- Demystifying Spectral Feature Learning for Instrumental Variable RegressionDimitri Meunier, Antoine Moulin, Jakub Wornbard, Vladimir Kostic et al.NeurIPS 2025 · 5 citations
- Learning Treatment Representations for Downstream Instrumental Variable RegressionShiangyi Lin, Hui Lan, Vasilis SyrgkanisICML 2026
- An Analysis of Causal Effect Estimation using Outcome Invariant Data AugmentationUzair Akbar, Niki Kilbertus, Hao Shen, Krikamol Muandet et al.NeurIPS 2025 · 3 citations
- Causal Inference with Conditional Instruments Using Deep Generative ModelsDebo Cheng, Ziqi Xu, Jiuyong Li, Lin Liu et al.AAAI 2023 · 24 citations
- Nonparametric Instrumental Variable Regression through Stochastic Approximate GradientsYuri R. Fonseca, Caio Peixoto, Yuri F. SaporitoNeurIPS 2024 · 8 citations
