Weakly Supervised High-Fidelity Clothing Model Generation
Ruili Feng, Cheng Ma, Chengji Shen, Xin Gao, Zhenjiang Liu, Xiaobo Li, Kairi Ou, Deli Zhao, Zheng-Jun Zha
摘要
The development of online economics arouses the demand of generating images of models on product clothes, to display new clothes and promote sales. However, the expensive proprietary model images challenge the existing image virtual try-on methods in this scenario, as most of them need to be trained on considerable amounts of model images accompanied with paired clothes images. In this paper, we propose a cheap yet scalable weakly-supervised method called Deep Generative Projection (DGP) to address this specific scenario. Lying in the heart of the proposed method is to imitate the process of human predicting the wearing effect, which is an unsupervised imagination based on life experience rather than computation rules learned from supervisions. Here a pretrained StyleGAN is used to capture the practical experience of wearing. Experiments show that projecting the rough alignment of clothing and body onto the StyleGAN space can yield photo-realistic wearing results. Experiments on real scene proprietary model images demonstrate the superiority of DGP over several state-of-the-art supervised methods when generating clothing model images. Model Clothing Synthesis results
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance FlowJunhong Gou, Siyu Sun, Jianfu Zhang, Jianlou Si 等ACM MM 2023 · 被引用 91 次
- Size Does Matter: Size-aware Virtual Try-on via Clothing-oriented Transformation Try-on NetworkChieh-Yun Chen, Yi-Chung Chen, Hong-Han Shuai, Wen-Huang ChengICCV 2023 · 被引用 38 次
- Shape-Guided Clothing Warping for Virtual Try-OnXiaoyu Han, Shunyuan Zheng, Zonglin Li, Chenyang Wang 等ACM MM 2024 · 被引用 5 次
- Linking Garment with Person via Semantically Associated Landmarks for Virtual Try-OnKeyu Yan, Tingwei Gao, Hui Zhang, Chengjun XieCVPR 2023
它引用的顶会 Paper19
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine 等NeurIPS 2020 · 被引用 2,345 次
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 被引用 1,195 次
- ClothFlow: A Flow-Based Model for Clothed Person GenerationXintong Han, Weilin Huang, Xiaojun Hu, Matthew R. ScottICCV 2019 · 被引用 297 次
- Towards Multi-Pose Guided Virtual Try-On NetworkHaoye Dong, Xiaodan Liang, Xiaohui Shen, Bochao Wang 等ICCV 2019 · 被引用 226 次
- VTNFP: An Image-Based Virtual Try-On Network With Body and Clothing Feature PreservationRuiyun Yu, Xiaoqi Wang, Xiaohui XieICCV 2019 · 被引用 184 次
相关 Paper
- Disentangled Cycle Consistency for Highly-Realistic Virtual Try-OnChongjian Ge, Yibing Song, Yuying Ge, Han Yang 等CVPR 2021
- Style-Based Global Appearance Flow for Virtual Try-OnSen He, Yi-Zhe Song, Tao XiangCVPR 2022 · 被引用 112 次
- Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-OnIgor Santesteban, Nils Thuerey, Miguel A. Otaduy, Dan CasasCVPR 2021
- Stable VITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-OnJeongho Kim, Gyojung Gu, Minho Park, Sunghyun Park 等CVPR 2024
- Learning to Transfer Texture From Clothing Images to 3D HumansAymen Mir, Thiemo Alldieck, Gerard Pons-MollCVPR 2020
