VerbDiff: Text-Only Diffusion Models with Enhanced Interaction Awareness
SeungJu Cha, Kwanyoung Lee, Ye-Chan Kim, Hyunwoo Oh, Dong-Jin Kim
2025Year
7Top-tier citations
Abstract
A photo of a man walking a bicycle on the street, carrying an umbrella" "A basketball player jumping and throwing a basketball and a man blocking the ball" Stable Diffusion GLIGEN InteractDiffusion VerbDiff (Ours) Real Figure 1. Generated samples illustrating multiple human-object interactions. Each color represents distinct humans, objects, and interaction words. GLIGEN [15] and InteractDiffusion [10] use grounding boxes as additional conditions, whereas Stable Diffusion [25] and VerbDiff rely solely on text.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- SIDA: Synthetic Image Driven Zero-shot Domain AdaptationYe-Chan Kim, SeungJu Cha, Si-Woo Kim, Taewhan Kim et al.ACM MM 2025 · 4 citations
- SAIL: Similarity-Aware Guidance and Inter-Caption Augmentation-based Learning for Weakly-Supervised Dense Video CaptioningYe-Chan Kim, SeungJu Cha, Si-Woo Kim, minju Jeon et al.CVPR 2026 · 1 citation
- Sali4Vid: Saliency-Aware Video Reweighting and Adaptive Caption Retrieval for Dense Video CaptioningMinJu Jeon, Si-Woo Kim, Ye-Chan Kim, HyunGee Kim et al.EMNLP 2025
- CatchPhrase: EXPrompt-Guided Encoder Adaptation for Audio-to-Image GenerationHyunwoo Oh, SeungJu Cha, Kwanyoung Lee, Si-Woo Kim et al.ACM MM 2025
- SynC: Synthetic Image Caption Dataset Refinement with One-to-many Mapping for Zero-shot Image CaptioningSi-Woo Kim, MinJu Jeon, Ye-Chan Kim, Soeun Lee et al.ACM MM 2025
Builds on20
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
Related papers
- InteractDiffusion: Interaction Control in Text-to-Image Diffusion ModelsJiun Tian Hoe, Xudong Jiang, Chee Seng Chan, Yap-Peng Tan et al.CVPR 2024
- Enhancing Compositional Text-to-Image Generation with Reliable Random SeedsShuangqi Li, Hieu Le, Jingyi Xu, Mathieu SalzmannICLR 2025
- Template Free Reconstruction of Human-object Interaction with Procedural Interaction GenerationXianghui Xie, Bharat Lal Bhatnagar, Jan Eric Lenssen, Gerard Pons-MollCVPR 2024 · 6 citations
- VODiff: Controlling Object Visibility Order in Text-to-Image GenerationDong Liang, Jinyuan Jia, Yuhao Liu, Zhanghan Ke et al.CVPR 2025
- Open-vocabulary Object Segmentation with Diffusion ModelsZiyi Li, Qinye Zhou, Xiaoyun Zhang, Ya Zhang et al.ICCV 2023 · 98 citations
