Automated Efficient Estimation using Monte Carlo Efficient Influence Functions
Raj Agrawal, Sam Witty, Andy Zane, Elias Bingham
摘要
Many practical problems involve estimating low dimensional statistical quantities with high-dimensional models and datasets. Several approaches address these estimation tasks based on the theory of influence functions, such as debiased/double ML or targeted minimum loss estimation. This paper introduces Monte Carlo Efficient Influence Functions (MC-EIF), a fully automated technique for approximating efficient influence functions that integrates seamlessly with existing differentiable probabilistic programming systems. MC-EIF automates efficient statistical estimation for a broad class of models and target functionals that would previously require rigorous custom analysis. We prove that MC-EIF is consistent, and that estimators using MC-EIF achieve optimal convergence rates. We show empirically that estimators using MC-EIF are at parity with estimators using analytic EIFs. Finally, we demonstrate a novel capstone example using MC-EIF for optimal portfolio selection.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Kernel Debiased Plug-in Estimation: Simultaneous, Automated Debiasing without Influence Functions for Many Target ParametersBrian M. Cho, Yaroslav Mukhin, Kyra Gan, Ivana MalenicaICML 2024 · 被引用 8 次
- Debiasing Synthetic Data Generated by Deep Generative ModelsAlexander Decruyenaere, Heidelinde Dehaene, Paloma Rabaey, Johan Decruyenaere 等NeurIPS 2024 · 被引用 5 次
它引用的顶会 Paper9
- Why Gradient Clipping Accelerates Training: A Theoretical Justification for AdaptivityJingzhao Zhang, Tianxing He, Suvrit Sra, Ali JadbabaieICLR 2020 · 被引用 598 次
- If Influence Functions are the Answer, Then What is the Question?Juhan Bae, Nathan Ng, Alston Lo, Marzyeh Ghassemi 等NeurIPS 2022 · 被引用 185 次
- Estimating Identifiable Causal Effects through Double Machine LearningYonghan Jung, Jin Tian, Elias BareinboimAAAI 2021 · 被引用 70 次
- RieszNet and ForestRiesz: Automatic Debiased Machine Learning with Neural Nets and Random ForestsVictor Chernozhukov, Whitney Newey, Victor Quintas-Martinez, Vasilis SyrgkanisICML 2022 · 被引用 61 次
- Doubly-Robust Self-TrainingBanghua Zhu, Mingyu Ding, Philip L. Jacobson, Ming Wu 等NeurIPS 2023 · 被引用 22 次
相关 Paper
- Kernel von Mises Formula of the Influence FunctionYaroslav MukhinNeurIPS 2025
- Bayesian Influence Functions for Hessian-Free Data AttributionPhilipp Alexander Kreer, Wilson Wu, Maxwell Adam, Zach Furman 等ICLR 2026 · 被引用 14 次
- Hamiltonian Monte Carlo using an adjoint-differentiated Laplace approximation: Bayesian inference for latent Gaussian models and beyondCharles C. Margossian, Aki Vehtari, Daniel Simpson, Raj AgrawalNeurIPS 2020 · 被引用 30 次
- Stochastic Bias-Reduced Gradient MethodsHilal Asi, Yair Carmon, Arun Jambulapati, Yujia Jin 等NeurIPS 2021 · 被引用 41 次
- Fearless Stochasticity in Expectation PropagationJonathan So, Richard E. TurnerNeurIPS 2024
