SceneComposer: Any-Level Semantic Image Synthesis
Yu Zeng, Zhe Lin, Jianming Zhang, Qing Liu, John P. Collomosse, Jason Kuen, Vishal M. Patel
Abstract
Adobe Research (a) (b) (c) (d) (e) Figure 1. Examples of image synthesis from any-level semantic layouts. (a) The coarsest layout, i.e. at the 0-th precision level, is equivalent to a text input; (d) the finest layout, i.e. at the highest level, is close to an accurate segmentation map; (a)-(d) intermediate level layouts (from coarse to fine), the shape control becomes tighter with increasing levels. (e) We can specify different precision levels for different components, e.g. to include a 0-th level style indicator while the remaining regions are of higher levels.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers12
- A-STAR: Test-time Attention Segregation and Retention for Text-to-image SynthesisAishwarya Agarwal, Srikrishna Karanam, K. J. Joseph, Apoorv Saxena et al.ICCV 2023 · 77 citations
- PHOTOSWAP: Personalized Subject Swapping in ImagesJing Gu, Yilin Wang, Nanxuan Zhao, Tsu-Jui Fu et al.NeurIPS 2023 · 58 citations
- Harnessing the Spatial-Temporal Attention of Diffusion Models for High-Fidelity Text-to-Image SynthesisQiucheng Wu, Yujian Liu, Handong Zhao, Trung Bui et al.ICCV 2023 · 55 citations
- Diffusion Handles Enabling 3D Edits for Diffusion Models by Lifting Activations to 3DKarran Pandey, Paul Guerrero, Matheus Gadelha, Yannick Hold-Geoffroy et al.CVPR 2024 · 19 citations
- Compose and Conquer: Diffusion-Based 3D Depth Aware Composable Image SynthesisJonghyun Lee, Hansam Cho, Young Joon Yoo, Seoung Bum Kim et al.ICLR 2024 · 12 citations
Builds on25
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
Related papers
- BachGAN: High-Resolution Image Synthesis From Salient Object LayoutYandong Li, Yu Cheng, Zhe Gan, Licheng Yu et al.CVPR 2020
- Freestyle Layout-to-Image SynthesisHan Xue, Zhiwu Huang, Qianru Sun, Li Song et al.CVPR 2023
- PLACE: Adaptive Layout-Semantic Fusion for Semantic Image SynthesisZhengyao Lv, Yuxiang Wei, Wangmeng Zuo, Kwan-Yee K. WongCVPR 2024 · 14 citations
- Synthesis of web layouts from examplesDylan Lukes, John Sarracino, Cora Coleman, Hila Peleg et al.FSE 2021 · 8 citations
- Diverse Semantic Image Synthesis via Probability Distribution ModelingZhentao Tan, Menglei Chai, Dongdong Chen, Jing Liao et al.CVPR 2021
