Specifying Object Attributes and Relations in Interactive Scene Generation
Oron Ashual, Lior Wolf
Abstract
We introduce a method for the generation of images from an input scene graph. The method separates between a layout embedding and an appearance embedding. The dual embedding leads to generated images that better match the scene graph, have higher visual quality, and support more complex scene graphs. In addition, the embedding scheme supports multiple and diverse output images per scene graph, which can be further controlled by the user. We demonstrate two modes of per-object control: (i) importing elements from other images, and (ii) navigation in the object space, by selecting an appearance archetype. Our code is publicly available at https://www. github.com/ashual/scene_generation .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 409f62b8-0eaf-4247-b0d1-c55f9b881156Cited by top-tier papers53
- Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion ModelsHila Chefer, Yuval Alaluf, Yael Vinker, Lior Wolf et al.SIGGRAPH 2023 · 438 citations
- Graph2Plan: learning floorplan generation from layout graphsRuizhen Hu, Zeyu Huang, Yuhan Tang, Oliver van Kaick et al.SIGGRAPH 2020 · 263 citations
- LayoutTransformer: Layout Generation and Completion with Self-attentionKamal Gupta, Justin Lazarow, Alessandro Achille, Larry Davis et al.ICCV 2021 · 184 citations
- Illiterate DALL-E Learns to ComposeGautam Singh, Fei Deng, Sungjin AhnICLR 2022 · 182 citations
- Text to Image Generation with Semantic-Spatial Aware GANWentong Liao, Kai Hu, Michael Ying Yang, Bodo RosenhahnCVPR 2022 · 169 citations
Related papers
- Scene Graph Disentanglement and Composition for Generalizable Complex Image GenerationYunnan Wang, Ziqiang Li, Wenyao Zhang, Zequn Zhang et al.NeurIPS 2024 · 16 citations
- Scene Graph-Grounded Image GenerationFuyun Wang, Tong Zhang, Yuanzhi Wang, Xiaoya Zhang et al.AAAI 2025 · 1 citation
- Controllable 3D Outdoor Scene Generation via Scene GraphsYuheng Liu, Xinke Li, Yuning Zhang, Lu Qi et al.ICCV 2025 · 13 citations
- End-to-End Optimization of Scene LayoutAndrew Luo, Zhoutong Zhang, Jiajun Wu, Joshua B. TenenbaumCVPR 2020
- MMGDreamer: Mixed-Modality Graph for Geometry-Controllable 3D Indoor Scene GenerationZhifei Yang, Keyang Lu, Chao Zhang, Jiaxing Qi et al.AAAI 2025 · 21 citations
