A Minimum Variance Path Principle for Accurate and Stable Score-Based Density Ratio Estimation
Wei Chen, Jiacheng Li, Shigui Li, Zhiqi Lin, Junmei Yang, John Paisley, Delu Zeng
摘要
Score-based methods are powerful across machine learning, but they face a paradox: theoretically path-independent, yet practically path-dependent. We resolve this by proving that practical training objectives differ from the ideal, ground-truth objective by a crucial, overlooked term: the path variance of the score function. We propose the MVP (Mimum Variance Path) Principle to minimize this path variance. Our key contribution is deriving a closed-form expression for the variance, making optimization tractable. By parameterizing the path with a flexible Kumaraswamy Mixture Model, our method learns data-adaptive, low-variance paths without heuristic manual selection. This principled optimization of the complete objective yields more accurate and stable estimators, establishing new state-of-the-art results on challenging benchmarks and providing a general framework for optimizing score-based interpolation. Our code can be found in https://github.com/Hoemr/OpenDRE.git.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Rényi Diffusion ModelsYirong Shen, Lu GAN, Cong LingICML 2026 · 被引用 4 次
- Flow-Based Density Ratio Estimation for Intractable Distributions with Applications in GenomicsEgor Antipov, Alessandro Palma, Lorenzo Consoli, Stephan Günnemann 等ICML 2026
它引用的顶会 Paper29
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 被引用 5,234 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Maximum Likelihood Training of Score-Based Diffusion ModelsYang Song, Conor Durkan, Iain Murray, Stefano ErmonNeurIPS 2021 · 被引用 958 次
- Guiding a Diffusion Model with a Bad Version of ItselfTero Karras, Miika Aittala, Tuomas Kynkäänniemi, Jaakko Lehtinen 等NeurIPS 2024 · 被引用 338 次
相关 Paper
- Traversing Distortion-Perception Tradeoff using a Single Score-Based Generative ModelYuhan Wang, Suzhi Bi, Ying-Jun Angela Zhang, Xiaojun YuanCVPR 2025
- SFESS: Score Function Estimators for k-Subset SamplingKlas Wijk, Ricardo Vinuesa, Hossein AzizpourICLR 2025
- Variational (Gradient) Estimate of the Score Function in Energy-based Latent Variable ModelsFan Bao, Kun Xu, Chongxuan Li, Lanqing Hong 等ICML 2021 · 被引用 10 次
- Density Ratio Estimation with Conditional Probability PathsHanlin Yu, Arto Klami, Aapo Hyvärinen, Anna Korba 等ICML 2025
- Generalization through variance: how noise shapes inductive biases in diffusion modelsJohn J. VastolaICLR 2025
