A Unified Density Operator View of Flow Control and Merging
Riccardo De Santi, Malte Franke, Ya-Ping Hsieh, Andreas Krause
摘要
Recent progress in large-scale flow and diffusion models raised two fundamental algorithmic challenges: control-based reward adaptation of pre-trained flows, and integration of multiple models, i.e., flow merging. While current approaches address them separately, we introduce a unifying probability-space framework that subsumes both as limit cases, and enables reward-guided flow merging, allowing principled, task-aware combination of multiple pre-trained flows (e.g., merging priors while maximizing drug-discovery utilities). Our formulation renders possible to express a rich family of operators over generative models densities, including intersection (e.g., to enforce safety), union (e.g., to compose diverse models), interpolation (e.g., for discovery), their reward-guided counterparts, as well as complex logical expressions via generative circuits. Next, we introduce Reward-Guided Flow Merging (RFM), a mirror-descent scheme that reduces reward-guided flow merging to a sequence of standard fine-tuning problems. Then, we provide first-of-their-kind theoretical guarantees for reward-guided and pure flow merging via RFM. Ultimately, we showcase the capabilities of the proposed method on illustrative settings providing visually interpretable insights, and apply our method to high-dimensional de-novo molecular design and low-energy conformer generation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Efficient Tail-Aware Generative Optimization via Flow Model Fine-TuningZifan Wang, Riccardo De Santi, Xiaoyu Mo, Michael Zavlanos 等ICML 2026 · 被引用 4 次
- Constrained Flow Optimization via Sequential Fine-Tuning for Molecular DesignSven Gutjahr, Riccardo De Santi, Luca Schaufelberger, Kjell Jorner 等ICML 2026 · 被引用 3 次
它引用的顶会 Paper22
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Equivariant Diffusion for Molecule Generation in 3DEmiel Hoogeboom, Victor Garcia Satorras, Clément Vignac, Max WellingICML 2022 · 被引用 865 次
- Safe RLHF: Safe Reinforcement Learning from Human FeedbackJosef Dai, Xuehai Pan, Ruiyang Sun, Jiaming Ji 等ICLR 2024 · 被引用 656 次
- DreamFusion: Text-to-3D using 2D DiffusionBen Poole, Ajay Jain, Jonathan T. Barron, Ben MildenhallICLR 2023 · 被引用 463 次
相关 Paper
- Flow Density Control: Generative Optimization Beyond Entropy-Regularized Fine-TuningRiccardo De Santi, Marin Vlastelica, Ya-Ping Hsieh, Zebang Shen 等NeurIPS 2025 · 被引用 17 次
- Verifier-Constrained Flow Expansion for Discovery Beyond the DataRiccardo De Santi, Kimon Protopapas, Ya-Ping Hsieh, Andreas KrauseICLR 2026 · 被引用 6 次
- RewardFlow: Generate Images by Optimizing What You RewardOnkar Susladkar, Dong-Hwan Jang, Tushar Prakash, Adheesh Sunil Juvekar 等CVPR 2026 · 被引用 2 次
- Compositional Flows for 3D Molecule and Synthesis Pathway Co-designTony Shen, Seonghwan Seo, Ross Irwin, Kieran Didi 等ICML 2025
- Interpolation-Based Conditioning of Flow Matching Models for Bioisosteric Ligand DesignYael Ziv, Martin Buttenschoen, Lukas Scheibelberger, Brian Marsden 等ICLR 2026 · 被引用 1 次
