Perceiving Ambiguity and Semantics without Recognition: An Efficient and Effective Ambiguous Scene Text Detector
Yan Shu, Wei Wang, Yu Zhou, Shaohui Liu, Aoting Zhang, Dongbao Yang, Weiping Wang
Abstract
Ambiguous scene text detection is an extremely challenging task. Existing text detectors that rely solely on visual cues often suffer from confusion due to being evenly distributed in rows/columns or incomplete detection owing to large character spacing. To overcome these challenges, the previous method recognizes a large number of proposals and utilizes semantic information predicted from recognition results to eliminate ambiguity. However, this method is inefficient, which limits their practical applications. In this paper, we propose a novel efficient and effective ambiguous text detector, which can Perceive Ambiguity and SEmantics without Recognition, termed PASER. On the one hand, PASER can perceive semantics without recognition with a light Perceiving Semantics (PerSem) module. In this way, proposals without reasonable semantics are filtered out, which largely speeds up the overall detection process. On the other hand, to detect both ambiguous and regular texts with a unified framework, PASER employs a Perceiving Ambiguity (PerAmb) module to distinguish ambiguous texts and regular texts, so that only the ambiguous proposals will be processed by PerSem while the regular texts are not, which further ensures the high efficiency. Extensive experiments show that our detector achieves state-of-the-art results on both ambiguous and regular scene text detection benchmarks. Notably, over 6 times faster speed and superior accuracy are achieved on TDA-ReCTS simultaneously.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers7
- TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance ControlWeichao Zeng, Yan Shu, Zhenhang Li, Dongbao Yang et al.NeurIPS 2024 · 55 citations
- LRANet: Towards Accurate and Efficient Scene Text Detection with Low-Rank Approximation NetworkYuchen Su, Zhineng Chen, Zhiwen Shao, Yuning Du et al.AAAI 2024 · 20 citations
- When Semantics Mislead Vision: Mitigating Large Multimodal Models Hallucinations in Scene Text Spotting and UnderstandingYan Shu, Hangui Lin, Yexin Liu, Yan Zhang et al.NeurIPS 2025 · 17 citations
- Focus, Distinguish, and Prompt: Unleashing CLIP for Efficient and Flexible Scene Text RetrievalGangyan Zeng, Yuan Zhang, Jin Wei, Dongbao Yang et al.ACM MM 2024 · 8 citations
- Arbitrary Reading Order Scene Text Spotter with Local Semantics GuidanceJiahao Lyu, Wei Wang, Dongbao Yang, Jinwen Zhong et al.AAAI 2025 · 6 citations
Related papers
- CRNet: A Center-aware Representation for Detecting Text of Arbitrary ShapesYu Zhou, Hongtao Xie, Shancheng Fang, Yan Li et al.ACM MM 2020 · 31 citations
- Efficient and Accurate Arbitrary-Shaped Text Detection With Pixel Aggregation NetworkWenhai Wang, Enze Xie, Xiaoge Song, Yuhang Zang et al.ICCV 2019 · 490 citations
- MOST: A Multi-Oriented Scene Text Detector With Localization RefinementMinghang He, Minghui Liao, Zhibo Yang, Humen Zhong et al.CVPR 2021
- TDI TextSpotter: Taking Data Imbalance into Account in Scene Text SpottingYu Zhou, Hongtao Xie, Shancheng Fang, Jing Wang et al.ACM MM 2021 · 4 citations
- SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text RecognitionZhi Qiao, Yu Zhou, Dongbao Yang, Yucan Zhou et al.CVPR 2020
