Layout-your-3D: Controllable and Precise 3D Generation with 2D Blueprint

Text prompt 3D instances (multi-view) 3D layout & compositional 3D '[A pigeon] having [a bagel] and [a beer]' 'A blue origami pigeon' 'A beer on fire' 'A bagel made out of grass' Custom text prompts LLM generated / User given 2D layout Figure 1: Layout-Your-3D generates high-quality compositional 3D scenes with given 2D layouts (top). Layout-Your-3D further enables editing each instance in the 3D scene with custom text prompts, achieving controllable and precise 3D generation (bottom).