TFG-Flow: Training-free Guidance in Multimodal Generative Flow
Haowei Lin, Shanda Li, Haotian Ye, Yiming Yang, Stefano Ermon, Yitao Liang, Jianzhu Ma
Abstract
Given an unconditional generative model and a predictor for a target property (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. As a highly efficient technique for steering generative models toward flexible outcomes, training-free guidance has gained increasing attention in diffusion models. However, existing methods only handle data in continuous spaces, while many scientific applications involve both continuous and discrete data (referred to as multimodality). Another emerging trend is the growing use of the simple and general flow matching framework in building generative foundation models, where guided generation remains under-explored. To address this, we introduce TFG-Flow, a novel training-free guidance method for multimodal generative flow. TFG-Flow addresses the curse-of-dimensionality while maintaining the property of unbiased sampling in guiding discrete variables. We validate TFG-Flow on four molecular design tasks and show that TFG-Flow has great potential in drug design by generating molecules with desired properties. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fc666d69-d897-44bd-893e-8b198ef74869Cited by top-tier papers6
- Training-Free Guidance Beyond Differentiability: Scalable Path Steering with Tree Search in Diffusion and Flow ModelsYingqing Guo, Yukang Yang, Hui Yuan, Mengdi WangNeurIPS 2025 · 29 citations
- PoseD-Flow: Versatile and Guided Flow Matching Model of Human PoseJebastin Nadar, Simone Foti, Tolga BirdalCVPR 2026 · 3 citations
- UniGEM: A Unified Approach to Generation and Property Prediction for MoleculesShikun Feng, Yuyan Ni, Yan Lu, Zhi-Ming Ma et al.ICLR 2025 · 3 citations
- DIVER: Diving Deeper into Distilled Data via Expressive Semantic RecoveryQianxin Xia, Zhiyong Shu, Wenbo Jiang, Jiawei Du et al.ICML 2026
- Plug-and-Play Guidance for Discrete Diffusion Models via Gradient-Informed Logit CorrectionHongkun Dou, Zike Chen, fengji Li, Hongjue Li et al.ICML 2026
Builds on53
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari et al.ICML 2024 · 3,620 citations
Related papers
- TFG: Unified Training-Free Guidance for Diffusion ModelsHaotian Ye, Haowei Lin, Jiaqi Han, Minkai Xu et al.NeurIPS 2024 · 118 citations
- Discrete Guidance Matching: Exact Guidance for Discrete Flow MatchingZhengyan Wan, Yidong Ouyang, Liyan Xie, Fang Fang et al.ICLR 2026 · 6 citations
- Unified Guidance for Geometry-Conditioned Molecular GenerationSirine Ayadi, Leon Hetzel, Johanna Sommer, Fabian J. Theis et al.NeurIPS 2024 · 11 citations
- Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-DesignAndrew Campbell, Jason Yim, Regina Barzilay, Tom Rainforth et al.ICML 2024 · 283 citations
- Training-free Multi-objective Diffusion Model for 3D Molecule GenerationXu Han, Caihua Shan, Yifei Shen, Can Xu et al.ICLR 2024 · 20 citations
