SIGMA-Gen: Structure and Identity Guided Multi-Subject Assembly for Image Generation
Oindrila Saha, Vojtech Krs, Radomir Mech, Subhransu Maji, Kevin James Blackburn-Matzen, Matheus Gadelha
Abstract
We present SIGMA-Gen, a unified framework for multi-identity preserving image generation. Unlike prior approaches, SIGMA-Gen is the first to enable single-pass multi-subject identity-preserved generation guided by both structural and spatial constraints. A key strength of our method is its ability to support user guidance at various levels of precision — from coarse 2D or 3D boxes to pixel-level segmentations and depth — with a single model. To enable this, we introduce SIGMA-Set27K, a novel synthetic dataset that provides identity, structure, and spatial information for over 100k unique subjects across 27k images. Through extensive evaluation we demonstrate that SIGMA-Gen achieves state-of-the-art performance in identity preservation, image generation quality, and speed.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on37
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann et al.ICLR 2024 · 4,569 citations
Related papers
- ContextGen: Contextual Layout Anchoring for Identity-Consistent Multi-Instance GenerationRuihang Xu, Dewei Zhou, Fan Ma, Yi YangICLR 2026 · 19 citations
- MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and DisentanglementDong She, Siming Fu, Mushui Liu, Qiaoqiao Jin et al.ICLR 2026 · 13 citations
- Scaling Multi-Identity Consistency for Image Customization via Multi-to-Multi Matching ParadigmYufeng Cheng, wenxu wu, Shaojin Wu, Mengqi Huang et al.CVPR 2026
- Inpaint-Anywhere: Zero-Shot Multi-Identity Inpainting with Efficient Diffusion TransformerJunsheng Luan, Lei Zhao, Wei XingAAAI 2026
- IDOL: Instant Photorealistic 3D Human Creation from a Single ImageYiyu Zhuang, Jiaxi Lv, Hao Wen, Qing Shuai et al.CVPR 2025
