Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Decoupled Attention Network for Text Recognition

About

Text recognition has attracted considerable research interests because of its various applications. The cutting-edge text recognition methods are based on attention mechanisms. However, most of attention methods usually suffer from serious alignment problem due to its recurrency alignment operation, where the alignment relies on historical decoding results. To remedy this issue, we propose a decoupled attention network (DAN), which decouples the alignment operation from using historical decoding results. DAN is an effective, flexible and robust end-to-end text recognizer, which consists of three components: 1) a feature encoder that extracts visual features from the input image; 2) a convolutional alignment module that performs the alignment operation based on visual features from the encoder; and 3) a decoupled text decoder that makes final prediction by jointly using the feature map and attention maps. Experimental results show that DAN achieves state-of-the-art performance on multiple text recognition tasks, including offline handwritten text recognition and regular/irregular scene text recognition.

Tianwei Wang, Yuanzhi Zhu, Lianwen Jin, Canjie Luo, Xiaoxue Chen, Yaqiang Wu, Qianying Wang, Mingxiang Cai• 2019

Related benchmarks

TaskDatasetResultRank
Scene Text RecognitionSVT (test)
Word Accuracy89.2
289
Scene Text RecognitionIIIT5K (test)
Word Accuracy94.3
244
Scene Text RecognitionIC15 (test)
Word Accuracy74.5
210
Scene Text RecognitionIC13 (test)
Word Accuracy94.2
207
Scene Text RecognitionSVTP (test)
Word Accuracy80
153
Scene Text RecognitionIIIT5K
Accuracy94.3
149
Handwritten text recognitionIAM (test)
CER6.4
102
Scene Text RecognitionSVT 647 (test)
Accuracy89.2
101
Scene Text RecognitionCUTE 288 samples (test)
Word Accuracy84.4
98
Scene Text RecognitionCUTE
Accuracy84.4
92
Showing 10 of 51 rows

Other info

Code

Follow for update