Self-Learning With Rectification Strategy for Human Parsing
Tao Li, Zhiyuan Liang, Sanyuan Zhao, Jiahao Gong, Jianbing Shen
Abstract
In this paper, we solve the sample shortage problem in the human parsing task. We begin with the self-learning strategy, which generates pseudo-labels for unlabeled data to retrain the model. However, directly using noisy pseudolabels will cause error amplification and accumulation. Considering the topology structure of human body, we propose a trainable graph reasoning method that establishes internal structural connections between graph nodes to correct two typical errors in the pseudo-labels, i.e., the global structural error and the local consistency error. For the global error, we first transform category-wise features into a high-level graph model with coarse-grained structural information, and then decouple the high-level graph to reconstruct the category features. The reconstructed features have a stronger ability to represent the topology structure of the human body. Enlarging the receptive field of features can effectively reducing the local error. We first project feature pixels into a local graph model to capture pixel-wise relations in a hierarchical graph manner, then reverse the relation information back to the pixels. With the global structural and local consistency modules, these errors are rectified and confident pseudo-labels are generated for retraining. Extensive experiments on the LIP and the ATR datasets demonstrate the effectiveness of our global and local rectification modules. Our method outperforms other state-of-the-art methods in supervised human parsing tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cb96a17d-8c2e-4eff-99ff-e3ec0087c404Cited by top-tier papers6
- Progressive One-shot Human ParsingHaoyu He, Jing Zhang, Bhavani Thuraisingham, Dacheng TaoAAAI 2021 · 20 citations
- Hierarchical Information Passing Based Noise-Tolerant Hybrid Learning for Semi-Supervised Human ParsingYunan Liu, Shanshan Zhang, Jian Yang, Pong Chi YuenAAAI 2021 · 14 citations
- Probabilistic Structural Latent Representation for Unsupervised EmbeddingMang Ye, Jianbing ShenCVPR 2020
- Multi-Mutual Consistency Induced Transfer Subspace Learning for Human Motion SegmentationTao Zhou, Huazhu Fu, Chen Gong, Jianbing Shen et al.CVPR 2020
- Semantic Human Parsing via Scalable Semantic Transfer Over Multiple Label DomainsJie Yang, Chaoqun Wang, Zhen Li, Junle Wang et al.CVPR 2023
Builds on9
- Human-Aware Motion DeblurringZiyi Shen, Wenguan Wang, Xiankai Lu, Jianbing Shen et al.ICCV 2019 · 374 citations
- Deep Self-Learning From Noisy LabelsJiangfan Han, Ping Luo, Xiaogang WangICCV 2019 · 315 citations
- Zero-Shot Video Object Segmentation via Attentive Graph Neural NetworksWenguan Wang, Xiankai Lu, Jianbing Shen, David J. Crandall et al.ICCV 2019 · 294 citations
- Learning Compositional Neural Information Fusion for Human ParsingWenguan Wang, Zhijie Zhang, Siyuan Qi, Jianbing Shen et al.ICCV 2019 · 131 citations
- Understanding Human Gaze Communication by Spatio-Temporal Graph ReasoningLifeng Fan, Wenguan Wang, Song-Chun Zhu, Xinyu Tang et al.ICCV 2019 · 124 citations
Related papers
- Prior Based Human CompletionZibo Zhao, Wen Liu, Yanyu Xu, Xianing Chen et al.CVPR 2021
- Grapy-ML: Graph Pyramid Mutual Learning for Cross-Dataset Human ParsingHaoyu He, Jing Zhang, Qiming Zhang, Dacheng TaoAAAI 2020 · 65 citations
- Reconstruct and Match: Out-of-Distribution Robustness via Topological HomogeneityChaoqi Chen, Luyao Tang, Hui HuangNeurIPS 2024 · 2 citations
- Hierarchical Human Parsing With Typed Part-Relation ReasoningWenguan Wang, Hailong Zhu, Jifeng Dai, Yanwei Pang et al.CVPR 2020
- CDGNet: Class Distribution Guided Network for Human ParsingKunliang Liu, Ouk Choi, Jianming Wang, Wonjun HwangCVPR 2022 · 44 citations
