Weakly Supervised High-Fidelity Clothing Model Generation
Ruili Feng, Cheng Ma, Chengji Shen, Xin Gao, Zhenjiang Liu, Xiaobo Li, Kairi Ou, Deli Zhao, Zheng-Jun Zha
Abstract
The development of online economics arouses the demand of generating images of models on product clothes, to display new clothes and promote sales. However, the expensive proprietary model images challenge the existing image virtual try-on methods in this scenario, as most of them need to be trained on considerable amounts of model images accompanied with paired clothes images. In this paper, we propose a cheap yet scalable weakly-supervised method called Deep Generative Projection (DGP) to address this specific scenario. Lying in the heart of the proposed method is to imitate the process of human predicting the wearing effect, which is an unsupervised imagination based on life experience rather than computation rules learned from supervisions. Here a pretrained StyleGAN is used to capture the practical experience of wearing. Experiments show that projecting the rough alignment of clothing and body onto the StyleGAN space can yield photo-realistic wearing results. Experiments on real scene proprietary model images demonstrate the superiority of DGP over several state-of-the-art supervised methods when generating clothing model images. Model Clothing Synthesis results
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance FlowJunhong Gou, Siyu Sun, Jianfu Zhang, Jianlou Si et al.ACM MM 2023 · 91 citations
- Size Does Matter: Size-aware Virtual Try-on via Clothing-oriented Transformation Try-on NetworkChieh-Yun Chen, Yi-Chung Chen, Hong-Han Shuai, Wen-Huang ChengICCV 2023 · 38 citations
- Shape-Guided Clothing Warping for Virtual Try-OnXiaoyu Han, Shunyuan Zheng, Zonglin Li, Chenyang Wang et al.ACM MM 2024 · 5 citations
- Linking Garment with Person via Semantically Associated Landmarks for Virtual Try-OnKeyu Yan, Tingwei Gao, Hui Zhang, Chengjun XieCVPR 2023
Builds on19
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- ClothFlow: A Flow-Based Model for Clothed Person GenerationXintong Han, Weilin Huang, Xiaojun Hu, Matthew R. ScottICCV 2019 · 297 citations
- Towards Multi-Pose Guided Virtual Try-On NetworkHaoye Dong, Xiaodan Liang, Xiaohui Shen, Bochao Wang et al.ICCV 2019 · 226 citations
- VTNFP: An Image-Based Virtual Try-On Network With Body and Clothing Feature PreservationRuiyun Yu, Xiaoqi Wang, Xiaohui XieICCV 2019 · 184 citations
Related papers
- Disentangled Cycle Consistency for Highly-Realistic Virtual Try-OnChongjian Ge, Yibing Song, Yuying Ge, Han Yang et al.CVPR 2021
- Style-Based Global Appearance Flow for Virtual Try-OnSen He, Yi-Zhe Song, Tao XiangCVPR 2022 · 112 citations
- Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-OnIgor Santesteban, Nils Thuerey, Miguel A. Otaduy, Dan CasasCVPR 2021
- Stable VITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-OnJeongho Kim, Gyojung Gu, Minho Park, Sunghyun Park et al.CVPR 2024
- Learning to Transfer Texture From Clothing Images to 3D HumansAymen Mir, Thiemo Alldieck, Gerard Pons-MollCVPR 2020
