Geometry Normalization Networks for Accurate Scene Text Detection
Jiaqi Duan, Youjiang Xu, Zhanghui Kuang, Xiaoyu Yue, Hongbin Sun, Yue Guan, Wayne Zhang
Abstract
Large geometry (e.g., orientation) variances are the key challenges in the scene text detection. In this work, we first conduct experiments to investigate the capacity of networks for learning geometry variances on detecting scene texts, and find that networks can handle only limited text geometry variances. Then, we put forward a novel Geometry Normalization Module (GNM) with multiple branches, each of which is composed of one Scale Normalization Unit and one Orientation Normalization Unit, to normalize each text instance to one desired canonical geometry range through at least one branch. The GNM is general and readily plugged into existing convolutional neural network based text detectors to construct end-to-end Geometry Normalization Networks (GNNets). Moreover, we propose a geometry-aware training scheme to effectively train the GNNets by sampling and augmenting text instances from a uniform geometry variance distribution. Finally, experiments on popular benchmarks of ICDAR 2015 and ICDAR 2017 MLT validate that our method outperforms all the state-of-the-art approaches remarkably by obtaining one-forward test F-scores of 88.52 and 74.54 respectively.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 268a9e6c-c669-403f-8440-7b947e33913fCited by top-tier papers5
- TextRay: Contour-based Geometric Modeling for Arbitrary-shaped Scene Text DetectionFangfang Wang, Yifeng Chen, Fei Wu, Xi LiACM MM 2020 · 112 citations
- Vision-Language Pre-Training for Boosting Scene Text DetectorsSibo Song, Jianqiang Wan, Zhibo Yang, Jun Tang et al.CVPR 2022 · 38 citations
- Mask is All You Need: Rethinking Mask R-CNN for Dense and Arbitrary-Shaped Scene Text DetectionXugong Qin, Yu Zhou, Youhui Guo, Dayan Wu et al.ACM MM 2021 · 33 citations
- Fourier Contour Embedding for Arbitrary-Shaped Text DetectionYiqin Zhu, Jianyong Chen, Lingyu Liang, Zhanghui Kuang et al.CVPR 2021
- MOST: A Multi-Oriented Scene Text Detector With Localization RefinementMinghang He, Minghui Liao, Zhibo Yang, Humen Zhong et al.CVPR 2021
Related papers
- Towards Unconstrained End-to-End Text SpottingSiyang Qin, Alessandro Bissacco, Michalis Raptis, Yasuhisa Fujii et al.ICCV 2019 · 138 citations
- CRNet: A Center-aware Representation for Detecting Text of Arbitrary ShapesYu Zhou, Hongtao Xie, Shancheng Fang, Yan Li et al.ACM MM 2020 · 31 citations
- Semantic-Aware Video Text DetectionWei Feng, Fei Yin, Xu-Yao Zhang, Cheng-Lin LiuCVPR 2021
- SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text RecognitionMingxin Huang, Yuliang Liu, Zhenghao Peng, Chongyu Liu et al.CVPR 2022 · 150 citations
- ContourNet: Taking a Further Step Toward Accurate Arbitrary-Shaped Scene Text DetectionYuxin Wang, Hongtao Xie, Zheng-Jun Zha, Mengting Xing et al.CVPR 2020
