Structure-Aware Flow Generation for Human Body Reshaping
Jianqiang Ren, Yuan Yao, Biwen Lei, Miaomiao Cui, Xuansong Xie
Abstract
Body reshaping is an important procedure in portrait photo retouching. Due to the complicated structure and multifarious appearance of human bodies, existing methods either fall back on the 3D domain via body morphable model or resort to keypoint-based image deformation, leading to inefficiency and unsatisfied visual quality. In this paper, we address these limitations by formulating an endto-end flow generation architecture under the guidance of body structural priors, including skeletons and Part Affinity Fields, and achieve unprecedentedly controllable performance under arbitrary poses and garments. A compositional attention mechanism is introduced for capturing both visual perceptual correlations and structural associations of the human body to reinforce the manipulation consistency among related parts. For a comprehensive evaluation, we construct the first large-scale body reshaping dataset, namely BR-5K, which contains 5,000 portrait photos as well as professionally retouched targets. Extensive experiments demonstrate that our approach significantly outperforms existing state-of-the-art methods in terms of visual performance, controllability, and efficiency. The dataset is available at our website: https://github.com/ JianqiangRen/FlowBasedBodyReshaping .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e10640b6-a77e-4171-93f7-9e7fda675c69Builds on7
- Detecting Photoshopped Faces by Scripting PhotoshopSheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens et al.ICCV 2019 · 147 citations
- Structure-aware Person Image Generation with Pose Decomposition and Semantic CorrelationJilin Tang, Yi Yuan, Tianjia Shao, Yong Liu et al.AAAI 2021 · 22 citations
- Deep Shapely PortraitsQinjie Xiao, Xiangjun Tang, You Wu, Leyang Jin et al.ACM MM 2020 · 11 citations
- Animating Through Warping: An Efficient Method for High-Quality Facial Expression AnimationZili Yi, Qiang Tang, Vishnu Sanjay Ramiya Srinivasan, Zhan XuACM MM 2020 · 8 citations
- Parametric Reshaping of Portraits in VideosXiangjun Tang, Wenxin Sun, Yong-Liang Yang, Xiaogang JinACM MM 2021 · 4 citations
Related papers
- Combining Attention with Flow for Person Image SynthesisYurui Ren, Yubo Wu, Thomas H. Li, Shan Liu et al.ACM MM 2021 · 16 citations
- Deep Image Spatial Transformation for Person Image GenerationYurui Ren, Xiaoming Yu, Junming Chen, Thomas H. Li et al.CVPR 2020
- FashionTailor: Controllable Clothing Editing for Human Images with Appearance PreservingJie Hou, Jianghong Ma, Xiangyu Mu, Haijun Zhang et al.AAAI 2025 · 1 citation
- Towards Hard-pose Virtual Try-on via 3D-aware Global Correspondence LearningZaiyu Huang, Hanhui Li, Zhenyu Xie, Michael Kampffmeyer et al.NeurIPS 2022 · 18 citations
- ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D PriorsAyush Chopra, Rishabh Jain, Mayur Hemani, Balaji KrishnamurthyICCV 2021 · 73 citations
