Decoupled Attention Network for Text Recognition
About
Text recognition has attracted considerable research interests because of its various applications. The cutting-edge text recognition methods are based on attention mechanisms. However, most of attention methods usually suffer from serious alignment problem due to its recurrency alignment operation, where the alignment relies on historical decoding results. To remedy this issue, we propose a decoupled attention network (DAN), which decouples the alignment operation from using historical decoding results. DAN is an effective, flexible and robust end-to-end text recognizer, which consists of three components: 1) a feature encoder that extracts visual features from the input image; 2) a convolutional alignment module that performs the alignment operation based on visual features from the encoder; and 3) a decoupled text decoder that makes final prediction by jointly using the feature map and attention maps. Experimental results show that DAN achieves state-of-the-art performance on multiple text recognition tasks, including offline handwritten text recognition and regular/irregular scene text recognition.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Scene Text Recognition | SVT (test) | Word Accuracy89.2 | 289 | |
| Scene Text Recognition | IIIT5K (test) | Word Accuracy94.3 | 244 | |
| Scene Text Recognition | IC15 (test) | Word Accuracy74.5 | 210 | |
| Scene Text Recognition | IC13 (test) | Word Accuracy94.2 | 207 | |
| Scene Text Recognition | SVTP (test) | Word Accuracy80 | 153 | |
| Scene Text Recognition | IIIT5K | Accuracy94.3 | 149 | |
| Handwritten text recognition | IAM (test) | CER6.4 | 102 | |
| Scene Text Recognition | SVT 647 (test) | Accuracy89.2 | 101 | |
| Scene Text Recognition | CUTE 288 samples (test) | Word Accuracy84.4 | 98 | |
| Scene Text Recognition | CUTE | Accuracy84.4 | 92 |