Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

GTC: Guided Training of CTC Towards Efficient and Accurate Scene Text Recognition

About

Connectionist Temporal Classification (CTC) and attention mechanism are two main approaches used in recent scene text recognition works. Compared with attention-based methods, CTC decoder has a much shorter inference time, yet a lower accuracy. To design an efficient and effective model, we propose the guided training of CTC (GTC), where CTC model learns a better alignment and feature representations from a more powerful attentional guidance. With the benefit of guided training, CTC model achieves robust and accurate prediction for both regular and irregular scene text while maintaining a fast inference speed. Moreover, to further leverage the potential of CTC decoder, a graph convolutional network (GCN) is proposed to learn the local correlations of extracted features. Extensive experiments on standard benchmarks demonstrate that our end-to-end model achieves a new state-of-the-art for regular and irregular scene text recognition and needs 6 times shorter inference time than attentionbased methods.

Wenyang Hu, Xiaocong Cai, Jun Hou, Shuai Yi, Zhiping Lin• 2020

Related benchmarks

TaskDatasetResultRank
Scene Text RecognitionSVT 647 (test)
Accuracy92.9
101
Scene Text RecognitionCUTE 288 samples (test)
Word Accuracy92.2
98
Scene Text RecognitionSVTP 645 (test)
Accuracy85.7
54
Scene Text RecognitionIIIT 3000 (test)
Accuracy95.8
35
Scene Text RecognitionIC15 1811 (test)
Accuracy79.5
30
Scene Text RecognitionIC13 1015 (test)
Accuracy94.4
27
Showing 6 of 6 rows

Other info

Follow for update