Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Revisiting Classification Perspective on Scene Text Recognition

About

The prevalent perspectives of scene text recognition are from sequence to sequence (seq2seq) and segmentation. Nevertheless, the former is composed of many components which makes implementation and deployment complicated, while the latter requires character level annotations that is expensive. In this paper, we revisit classification perspective that models scene text recognition as an image classification problem. Classification perspective has a simple pipeline and only needs word level annotations. We revive classification perspective by devising a scene text recognition model named as CSTR, which performs as well as methods from other perspectives. The CSTR model consists of CPNet (classification perspective network) and SPPN (separated conv with global average pooling prediction network). CSTR is as simple as image classification model like ResNet \cite{he2016deep} which makes it easy to implement and deploy. We demonstrate the effectiveness of the classification perspective on scene text recognition with extensive experiments. Futhermore, CSTR achieves nearly state-of-the-art performance on six public benchmarks including regular text, irregular text. The code will be available at https://github.com/Media-Smart/vedastr.

Hongxiang Cai, Jun Sun, Yichao Xiong• 2021

Related benchmarks

TaskDatasetResultRank
Scene Text RecognitionIC15 (test)
Word Accuracy86.1
210
Scene Text RecognitionIC13 (test)
Word Accuracy94.1
207
Scene Text RecognitionIIIT5K
Accuracy90.1
149
Scene Text RecognitionSVT 647 (test)
Accuracy92.3
101
Scene Text RecognitionIC15
Accuracy81.6
86
Scene Text RecognitionSVT
Accuracy93.7
67
Scene Text RecognitionIC03
Accuracy94.8
67
Scene Text RecognitionIC13
Accuracy93.2
66
Scene Text RecognitionIIIT5K 3,000 samples (test)
Word Accuracy94.2
59
Scene Text RecognitionSVTP 645 (test)
Accuracy86.2
54
Showing 10 of 20 rows

Other info

Code

Follow for update