MISC: Multi-Condition Injection and Spatially-Adaptive Compositing for Conditional Person Image Synthesis
Shuchen Weng, Wenbo Li, Dawei Li, Hongxia Jin, Boxin Shi
Abstract
In this paper, we explore synthesizing person images with multiple conditions for various backgrounds. To this end, we propose a framework named "MISC" for conditional image generation and image compositing. For conditional image generation, we improve the existing condition injection mechanisms by leveraging the inter-condition correlations. For the image compositing, we theoretically prove the weaknesses of the cutting-edge methods, and make it more robust by removing the spatially-invariance constraint, and enabling the bounding mechanism and the spatial adaptability. We show the effectiveness of our method on the Video Instance-level Parsing dataset, and demonstrate the robustness through controllability tests.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 72996445-846c-48da-81f1-be94ac7a384cCited by top-tier papers11
- Text2Human: text-driven controllable human image generationYuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu et al.SIGGRAPH 2022 · 140 citations
- Shadow Generation for Composite Image in Real-World ScenesYan Hong, Li Niu, Jianfu ZhangAAAI 2022 · 55 citations
- AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D DiffusionShuo Huang, Zongxin Yang, Liangting Li, Yi Yang et al.ACM MM 2023 · 19 citations
- High-Resolution Image Harmonization with Adaptive-Interval Color TransformationQuanling Meng, Qinglin Liu, Zonglin Li, Xiangyuan Lan et al.NeurIPS 2024 · 16 citations
- Language-guided Image Reflection SeparationHaofeng Zhong, Yuchen Hong, Shuchen Weng, Jinxiu Liang et al.CVPR 2024 · 14 citations
Related papers
- Unicombine: Unified Multi-Conditional Combination with Diffusion TransformerHaoxuan Wang, Jinlong Peng, Qingdong He, Hao Yang et al.ICCV 2025 · 6 citations
- PISE: Person Image Synthesis and Editing With Decoupled GANJinsong Zhang, Kun Li, Yu-Kun Lai, Jingyu YangCVPR 2021
- IMAGPose: A Unified Conditional Framework for Pose-Guided Person GenerationFei Shen, Jinhui TangNeurIPS 2024 · 172 citations
- CareCom: Generative Image Composition with Calibrated Reference FeaturesJiaxuan Chen, Bo Zhang, Qingdong He, Jinlong Peng et al.AAAI 2026
- Wish You Were Here: Context-Aware Human GenerationOran Gafni, Lior WolfCVPR 2020
