Aggregation via Separation: Boosting Facial Landmark Detector With Semi-Supervised Style Translation
Shengju Qian, Keqiang Sun, Wayne Wu, Chen Qian, Jiaya Jia
Abstract
Facial landmark detection, or face alignment, is a fundamental task that has been extensively studied. In this paper, we investigate a new perspective of facial landmark detection and demonstrate it leads to further notable improvement. Given that any face images can be factored into space of style that captures lighting, texture and image environment, and a style-invariant structure space, our key idea is to leverage disentangled style and shape space of each individual to augment existing structures via style translation. With these augmented synthetic samples, our semi-supervised model surprisingly outperforms the fully-supervised one by a large margin. Extensive experiments verify the effectiveness of our idea with state-of-the-art results on WFLW [69], 300W [56], COFW [7] , and AFLW [36] datasets. Our proposed structure is general and could be assembled into any face alignment frameworks. The code is made publicly available at https://github.com/thesouthfrog/stylealign .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6248cdc9-d2ed-4c4a-b2f0-9c640f3ee8a9Cited by top-tier papers24
- General Facial Representation Learning in a Visual-Linguistic MannerYinglin Zheng, Hao Yang, Ting Zhang, Jianmin Bao et al.CVPR 2022 · 161 citations
- Temporal Interlacing NetworkHao Shao, Shengju Qian, Yu LiuAAAI 2020 · 116 citations
- Controllable 3D Face Synthesis with Conditional Generative Occupancy FieldsKeqiang Sun, Shangzhe Wu, Zhaoyang Huang, Ning Zhang et al.NeurIPS 2022 · 62 citations
- Sparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation LearningJiahao Xia, Weiwei Qu, Wenjian Huang, Jianguo Zhang et al.CVPR 2022 · 50 citations
- Towards Accurate Facial Landmark Detection via Cascaded TransformersHui Li, Zidong Guo, Seon-Min Rhee, Seungju Han et al.CVPR 2022 · 45 citations
Related papers
- Exploiting Self-Supervised and Semi-Supervised Learning for Facial Landmark Tracking with Unlabeled DataShi Yin, Shangfei Wang, Xiaoping Chen, Enhong ChenACM MM 2020 · 7 citations
- FAB: A Robust Facial Landmark Detection Framework for Motion-Blurred VideosKeqiang Sun, Wayne Wu, Tinghao Liu, Shuo Yang et al.ICCV 2019 · 32 citations
- STAR Loss: Reducing Semantic Ambiguity in Facial Landmark DetectionZhenglin Zhou, Huaxia Li, Hong Liu, Nanyang Wang et al.CVPR 2023
- ATF: Towards Robust Face Alignment via Leveraging Similarity and Diversity across Different DatasetsXing Lan, Qinghao Hu, Fangzhou Xiong, Cong Leng et al.ACM MM 2020 · 5 citations
- FreeEnricher: Enriching Face Landmarks without Additional CostYangyu Huang, Xi Chen, Jongyoo Kim, Hao Yang et al.AAAI 2023 · 3 citations
