Automated Efficient Estimation using Monte Carlo Efficient Influence Functions
Raj Agrawal, Sam Witty, Andy Zane, Elias Bingham
Abstract
Many practical problems involve estimating low dimensional statistical quantities with high-dimensional models and datasets. Several approaches address these estimation tasks based on the theory of influence functions, such as debiased/double ML or targeted minimum loss estimation. This paper introduces Monte Carlo Efficient Influence Functions (MC-EIF), a fully automated technique for approximating efficient influence functions that integrates seamlessly with existing differentiable probabilistic programming systems. MC-EIF automates efficient statistical estimation for a broad class of models and target functionals that would previously require rigorous custom analysis. We prove that MC-EIF is consistent, and that estimators using MC-EIF achieve optimal convergence rates. We show empirically that estimators using MC-EIF are at parity with estimators using analytic EIFs. Finally, we demonstrate a novel capstone example using MC-EIF for optimal portfolio selection.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e82a78e2-2fe6-4f59-8a0e-4de1cc867f2eCited by top-tier papers2
- Kernel Debiased Plug-in Estimation: Simultaneous, Automated Debiasing without Influence Functions for Many Target ParametersBrian M. Cho, Yaroslav Mukhin, Kyra Gan, Ivana MalenicaICML 2024 · 8 citations
- Debiasing Synthetic Data Generated by Deep Generative ModelsAlexander Decruyenaere, Heidelinde Dehaene, Paloma Rabaey, Johan Decruyenaere et al.NeurIPS 2024 · 5 citations
Builds on9
- Why Gradient Clipping Accelerates Training: A Theoretical Justification for AdaptivityJingzhao Zhang, Tianxing He, Suvrit Sra, Ali JadbabaieICLR 2020 · 598 citations
- If Influence Functions are the Answer, Then What is the Question?Juhan Bae, Nathan Ng, Alston Lo, Marzyeh Ghassemi et al.NeurIPS 2022 · 185 citations
- Estimating Identifiable Causal Effects through Double Machine LearningYonghan Jung, Jin Tian, Elias BareinboimAAAI 2021 · 70 citations
- RieszNet and ForestRiesz: Automatic Debiased Machine Learning with Neural Nets and Random ForestsVictor Chernozhukov, Whitney Newey, Victor Quintas-Martinez, Vasilis SyrgkanisICML 2022 · 61 citations
- Doubly-Robust Self-TrainingBanghua Zhu, Mingyu Ding, Philip L. Jacobson, Ming Wu et al.NeurIPS 2023 · 22 citations
Related papers
- Kernel von Mises Formula of the Influence FunctionYaroslav MukhinNeurIPS 2025
- Bayesian Influence Functions for Hessian-Free Data AttributionPhilipp Alexander Kreer, Wilson Wu, Maxwell Adam, Zach Furman et al.ICLR 2026 · 14 citations
- Hamiltonian Monte Carlo using an adjoint-differentiated Laplace approximation: Bayesian inference for latent Gaussian models and beyondCharles C. Margossian, Aki Vehtari, Daniel Simpson, Raj AgrawalNeurIPS 2020 · 30 citations
- Stochastic Bias-Reduced Gradient MethodsHilal Asi, Yair Carmon, Arun Jambulapati, Yujia Jin et al.NeurIPS 2021 · 41 citations
- Fearless Stochasticity in Expectation PropagationJonathan So, Richard E. TurnerNeurIPS 2024
