Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

An Empirical Study of Scaling Law for OCR

About

The laws of model size, data volume, computation and model performance have been extensively studied in the field of Natural Language Processing (NLP). However, the scaling laws in Optical Character Recognition (OCR) have not yet been investigated. To address this, we conducted comprehensive studies that involved examining the correlation between performance and the scale of models, data volume and computation in the field of text recognition.Conclusively, the study demonstrates smooth power laws between performance and model size, as well as training data volume, when other influencing factors are held constant. Additionally, we have constructed a large-scale dataset called REBU-Syn, which comprises 6 million real samples and 18 million synthetic samples. Based on our scaling law and new dataset, we have successfully trained a scene text recognition model, achieving a new state-ofthe-art on 6 common test benchmarks with a top-1 average accuracy of 97.42%. The models and dataset are publicly available at https://github.com/large-ocr-model/large-ocr-model.github.io.

Miao Rang, Zhenni Bi, Chuanjian Liu, Yunhe Wang, Kai Han• 2023

Related benchmarks

TaskDatasetResultRank
Scene Text RecognitionSVT (test)
Word Accuracy98.76
289
Scene Text RecognitionIIIT5K (test)
Word Accuracy99.13
244
Scene Text RecognitionIC15 (test)
Word Accuracy92.6
210
Scene Text RecognitionIC13 (test)
Word Accuracy99.42
207
Scene Text RecognitionSVTP (test)
Word Accuracy98.13
153
Scene Text RecognitionIC13, IC15, IIIT, SVT, SVTP, CUTE80 Average of 6 benchmarks (test)
Average Accuracy97.42
105
Scene Text RecognitionSVT 647 (test)--
101
Scene Text RecognitionCUTE 288 samples (test)--
98
Scene Text RecognitionCUTE80 (test)
Accuracy0.9965
87
Scene Text RecognitionIIIT5K 3,000 samples (test)--
59
Showing 10 of 13 rows

Other info

Code

Follow for update