Visual Persona: Foundation Model for Full-Body Human Customization
Jisu Nam, Soowon Son, Zhan Xu, Jing Shi, Difan Liu, Feng Liu, Seungryong Kim, Yang Zhou
Abstract
We introduce Visual Persona, a foundation model for textto-image full-body human customization that, given a single in-the-wild human image, generates diverse images of the individual guided by text descriptions. Unlike prior methods that focus solely on preserving facial identity, our approach captures detailed full-body appearance, aligning with text descriptions for body structure and scene variations. Training this model requires large-scale paired human data, consisting of multiple images per individual with consistent full-body identities, which is notoriously difficult to obtain. To address this, we propose a data curation pipeline leveraging vision-language models to evaluate fullbody appearance consistency, resulting in Visual Persona-500K-a dataset of 580k paired human images across 100k unique identities. For precise appearance transfer, we introduce a transformer encoder-decoder architecture adapted to a pre-trained text-to-image diffusion model, which augments the input image into distinct body regions, encodes these regions as local appearance features, and projects them into dense identity embeddings independently to condition the diffusion model for synthesizing customized images. Visual Persona consistently surpasses existing approaches, generating high-quality, customized images from in-the-wild inputs. Extensive ablation studies validate design choices, and we demonstrate the versatility of Visual Persona across various downstream tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 41c83c6d-6529-47d8-ac7e-7d478d774e12Cited by top-tier papers4
- Emergent Temporal Correspondences from Video Diffusion TransformersJisu Nam, Soowon Son, Dahyun Chung, Jiyoung Kim et al.NeurIPS 2025 · 30 citations
- Consistent Story Generation: Unlocking the Potential of Zigzag SamplingMingxiao Li, Mang Ning, Marie-Francine MoensNeurIPS 2025 · 2 citations
- Teleportraits: Training-Free People Insertion Into Any SceneJialu Gao, K. J. Joseph, Fernando De la TorreICCV 2025
- Semantic Alignment for Pose-Invariant Identity Preserving DiffusionJiwon Kim, Seonhwa Kim, Soobin Park, Eunju Cha et al.CVPR 2026
Builds on36
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
Related papers
- Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet SupervisionHyunsoo Cha, Wonjung Woo, Byungjun Kim, Hanbyul JooCVPR 2026 · 1 citation
- Text2Human: text-driven controllable human image generationYuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu et al.SIGGRAPH 2022 · 140 citations
- Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction ScenesWenxuan Peng, Bharath Hariharan, Hadar Averbuch-ElorSIGGRAPH 2026
- MagicMirror: ID-Preserved Video Generation in Video Diffusion TransformersYuechen Zhang, Yaoyang Liu, Bin Xia, Bohao Peng et al.ICCV 2025 · 1 citation
- Human Body Restoration with One-Step Diffusion Model and A New BenchmarkJue Gong, Jingkai Wang, Zheng Chen, Xin Liu et al.ICML 2025
