Diffusion Probe: Generated Image Result Prediction Using CNN Probes
Bukun Huang, Benlei Cui, Zhizeng Ye, Xuemei Dong, Tuo Chen, Hui Xue, Dingkang Yang, Longtao Huang, Haiwen Hong, Jingqun Tang
摘要
Text-to-image (T2I) diffusion models currently lack an efficient mechanism for early quality assessment, forcing costly random trial-and-error in scenarios requiring multiple generations (e.g., iterating on prompts, agent-based image generation, flow-grpo). To address this, we first reveal a strong correlation between the attention distribution in the early diffusion process and the final image quality. Building upon this insight, we introduce Diffusion Probe, a pioneering framework that leverages the model's internal cross-attention maps as a predictive signal. We propose a lightweight predictor, trained to establish a direct mapping from statistical properties of these nascent crossattention distributions-extracted from the initial denoising steps-to the final image's comprehensive quality. This allows our probe to accurately forecast various aspects of image quality, regardless of the specific ground-truth quality metric, long before full synthesis is complete. We empirically validate the reliability and generalizability of Diffusion Probe through its consistently strong predictive accuracy across a wide spectrum of conditions. On diverse T2I models, throughout broad early-denoising windows, across various resolutions, and with different quality metrics, it achieves high correlation (PCC > 0.7) and classification performance (AUC-ROC > 0.9). This intrinsic reliability is further demonstrated in practice by successfully optimizing T2I workflows that benefit from early, qualityguided decisions, such as Prompt Optimization, Seed Se-
‡ Project leader.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper23
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li 等NeurIPS 2022 · 被引用 8,965 次
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann 等ICLR 2024 · 被引用 4,569 次
相关 Paper
- Toward Early Quality Assessment of Text-to-Image Diffusion ModelsHuanlei Guo, Hongxin Wei, Bingyi JingCVPR 2026 · 被引用 2 次
- Diffusion Lens: Interpreting Text Encoders in Text-to-Image PipelinesMichael Toker, Hadas Orgad, Mor Ventura, Dana Arad 等ACL 2024
- Text Embedding is Not All You Need: Attention Control for Text-to-Image Semantic Alignment with Text Self-Attention MapsJeeyung Kim, Erfan Esmaeili, Qiang QiuCVPR 2025
- The Silent Assistant: NoiseQuery as Implicit Guidance for Goal-Driven Image GenerationRuoyu Wang, Huayang Huang, Ye Zhu, Olga Russakovsky 等ICCV 2025 · 被引用 3 次
- I2AM: Interpreting Image-to-Image Latent Diffusion Models via Bi-Attribution MapsJunseo Park, Hyeryung JangICLR 2025
