Overclocking Electrostatic Generative Models
Daniil Shlenskii, Aleksandr Korotin
摘要
Electrostatic generative models such as PFGM++ have recently emerged as a powerful framework, achieving competitive performance in image synthesis. PFGM++ operates in an extended data space with auxiliary dimensionality D, recovering the diffusion model framework as D → ∞, while yielding superior empirical results for finite D. Like diffusion models, PFGM++ relies on expensive ODE simulations to generate samples, making it computationally costly. To address this, we propose Inverse Poisson Flow Matching (IPFM), a principled distillation framework that accelerates electrostatic generative models across all values of D. Our IPFM reformulates distillation as an inverse problem: learning a generator whose induced electrostatic field matches that of the teacher. We derive a tractable training objective for this problem and show that, as D → ∞, our IPFM closely recovers Score Identity Distillation (SiD), a recent method for distilling diffusion models. Empirically, our IPFM produces distilled generators that achieve near-teacher or even superior sample quality using only a few function evaluations. Moreover, we find that onestep generator distillation converges faster at finite D than in the D → ∞ diffusion limit, aligning with prior evidence that finite-D PFGM++ models offer more favorable optimization and sampling behavior. Project repository: https: //github.com/daniil-shlenskii/ipfm.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 被引用 3,959 次
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 被引用 1,720 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Improved Distribution Matching Distillation for Fast Image SynthesisTianwei Yin, Michaël Gharbi, Taesung Park, Richard Zhang 等NeurIPS 2024 · 被引用 728 次
相关 Paper
- Poisson Flow Generative ModelsYilun Xu, Ziming Liu, Max Tegmark, Tommi S. JaakkolaNeurIPS 2022 · 被引用 133 次
- PFGM++: Unlocking the Potential of Physics-Inspired Generative ModelsYilun Xu, Ziming Liu, Yonglong Tian, Shangyuan Tong 等ICML 2023 · 被引用 97 次
- Physics-Informed Distillation of Diffusion Models for PDE-Constrained GenerationYi Zhang, Peng Wang, Difan ZouICML 2026 · 被引用 9 次
- SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion DistillationZhuguanyu Wu, Ruihao Gong, Yang Yong, Yushi Huang 等ICML 2026 · 被引用 2 次
- One-Step Diffusion with Distribution Matching DistillationTianwei Yin, Michaël Gharbi, Richard Zhang, Eli Shechtman 等CVPR 2024 · 被引用 75 次
