TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimization
Chia-Yu Hung, Navonil Majumder, Zhifeng Kong, Ambuj Mehrish, Amir Zadeh, Chuan Li, Rafael Valle, Bryan Catanzaro, Soujanya Poria
摘要
We introduce TangoFlux, an efficient Text-to-Audio (TTA) generative model with 515M parameters, capable of generating up to 30 seconds of 44.1kHz audio in 3.7 seconds on a A40 GPU. A key challenge in aligning TTA models lies in creating preference pairs, as TTA lacks structured mechanisms like verifiable rewards or gold-standard answers available for Large Language Models (LLMs). To address this, we propose CLAP-Ranked Preference Optimization (CRPO), a novel framework that iteratively generates and optimizes preference data to enhance TTA alignment. We show that the audio preference dataset generated using CRPO outperforms the static alternatives. With this framework, TangoFlux achieves state-of-the-art performance across both objective and subjective benchmarks. https://tangoflux.github.io/ holds the model-generated audio samples for comparison.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper20
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean FlowsXiquan Li, Junxi Liu, Yuzhe Liang, Zhikang Niu 等ACL 2026 · 被引用 25 次
- JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video GenerationKai Liu, Yanhao Zheng, Kai Wang, Shengqiong Wu 等ICLR 2026 · 被引用 24 次
- UALM: Unified Audio Language Model for Understanding, Generation and ReasoningJinchuan Tian, Sang-gil Lee, Zhifeng Kong, Sreyan Ghosh 等ICLR 2026 · 被引用 17 次
- SonicMaster: Towards Controllable All-in-One Music Restoration and MasteringJan Melechovsky, Ambuj Mehrish, Abhinaba Roy, Dorien HerremansICML 2026 · 被引用 11 次
- MeanCache: From Instantaneous to Average Velocity for Accelerating Flow Matching InferenceHuanlin Gao, Ping Chen, Fuyuan Shi, Ruijia Wu 等ICLR 2026 · 被引用 7 次
它引用的顶会 Paper26
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida 等NeurIPS 2022 · 被引用 24,707 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning 等NeurIPS 2023 · 被引用 10,924 次
相关 Paper
- Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference OptimizationNavonil Majumder, Chia-Yu Hung, Deepanway Ghosal, Wei-Ning Hsu 等ACM MM 2024 · 被引用 52 次
- Synthio: Augmenting Small-Scale Audio Classification Datasets with Synthetic DataSreyan Ghosh, Sonal Kumar, Zhifeng Kong, Rafael Valle 等ICLR 2025
- Text-to-Audio Generation using Instruction Guided Latent Diffusion ModelDeepanway Ghosal, Navonil Majumder, Ambuj Mehrish, Soujanya PoriaACM MM 2023 · 被引用 90 次
- Advancing Audio-Based Text Generation with Imbalance Preference OptimizationZhenghao Zhou, Yongjie Liu, Chen CaoAAAI 2025 · 被引用 3 次
- DiffPO: Diffusion-styled Preference Optimization for Inference Time Alignment of Large Language ModelsRuizhe Chen, Wenhao Chai, Zhifei Yang, Xiaotian Zhang 等ACL 2025
