Outcome-Aware Spectral Feature Learning for Instrumental Variable Regression
Dimitri Meunier, Jakub Wornbard, Vladimir Kostic, Antoine Moulin, Alek Fröhlich, Karim Lounici, Massimiliano Pontil, Arthur Gretton
摘要
We address the problem of causal effect estimation in the presence of hidden confounders using nonparametric instrumental variable (IV) regression. An established approach is to use estimators based on learned spectral features, that is, features spanning the top singular subspaces of the operator linking treatments to instruments. While powerful, such features are agnostic to the outcome variable. Consequently, the method can fail when the true causal function is poorly represented by these dominant singular functions. To mitigate this, we introduce Augmented Spectral Feature Learning, a framework that makes the feature-learning process outcome-aware. Our method learns features by minimizing a novel contrastive loss derived from an augmented operator that incorporates information from the outcome. By learning these task-specific features, our approach remains effective even in the presence of spectral misalignment. We provide a theoretical analysis of this framework and validate our approach on challenging benchmarks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper11
- Neural Networks Fail to Learn Periodic Functions and How to Fix ItLiu Ziyin, Tilman Hartwig, Masahito UedaNeurIPS 2020 · 被引用 249 次
- Minimax Estimation of Conditional Moment ModelsNishanth Dikkala, Greg Lewis, Lester Mackey, Vasilis SyrgkanisNeurIPS 2020 · 被引用 125 次
- Learning Deep Features in Instrumental Variable RegressionLiyuan Xu, Yutian Chen, Siddarth Srinivasan, Nando de Freitas 等ICLR 2021 · 被引用 85 次
- Deep Proxy Causal Learning and its Application to Confounded Bandit Policy EvaluationLiyuan Xu, Heishiro Kanagawa, Arthur GrettonNeurIPS 2021 · 被引用 52 次
- Provably Efficient Neural Estimation of Structural Equation Models: An Adversarial ApproachLuofeng Liao, You-Lin Chen, Zhuoran Yang, Bo Dai 等NeurIPS 2020 · 被引用 40 次
相关 Paper
- Demystifying Spectral Feature Learning for Instrumental Variable RegressionDimitri Meunier, Antoine Moulin, Jakub Wornbard, Vladimir Kostic 等NeurIPS 2025 · 被引用 5 次
- Learning Treatment Representations for Downstream Instrumental Variable RegressionShiangyi Lin, Hui Lan, Vasilis SyrgkanisICML 2026
- An Analysis of Causal Effect Estimation using Outcome Invariant Data AugmentationUzair Akbar, Niki Kilbertus, Hao Shen, Krikamol Muandet 等NeurIPS 2025 · 被引用 3 次
- Causal Inference with Conditional Instruments Using Deep Generative ModelsDebo Cheng, Ziqi Xu, Jiuyong Li, Lin Liu 等AAAI 2023 · 被引用 24 次
- Nonparametric Instrumental Variable Regression through Stochastic Approximate GradientsYuri R. Fonseca, Caio Peixoto, Yuri F. SaporitoNeurIPS 2024 · 被引用 8 次
