Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

OmniDocBench

Benchmarks

Task NameDataset NameSOTA ResultTrend
Document ParsingOmniDocBench v1.5
Overall Score94.62
195
Document ParsingOmniDocBench 1.5 (test)
Text Edit Error0.021
132
Document ParsingOmniDocBench Full v1.6
Overall Accuracy95.69
44
Document ParsingOmniDocBench
Overall Accuracy90.41
32
Document ParsingOmniDocBench Real5 warping
Overall Score91.25
32
Document ParsingOmniDocBench Real5 skewing variation
Overall Score91.66
32
Document ParsingReal5-OmniDocBench (screen-photography)
Overall Score93.46
32
Document RecognitionOmniDocBench
Overall Score94.5
29
Reading Order DetectionOmniDocBench ZH v1.0
Edit Distance0.055
28
Reading Order DetectionOmniDocBench EN v1.0
Edit Distance0.038
28
Document ParsingOmniDocBench Real5
Score94.07
26
OCR-related Parsing TasksOmniDocBench English
Edit Distance0.032
23
Reading Order DetectionOmniDocBench v1.5
Edit Distance0.043
21
Document UnderstandingOmniDocBench standard (test)
Overall Score93.75
19
Document ParsingOmniDocBench Real5 illumination
Overall Score0.9216
19
Document ParsingReal5-OmniDocBench scanning scenario 1.5 (test)
Overall Score93.43
19
Document ParsingReal5-OmniDocBench 5-distortion types (test)
Overall Accuracy92.05
19
Page-level OCROmniDocBench English DODO evaluation setting
Normalized Edit Distance3.2
17
Document ParsingOmniDocBench EN
Text Score78
16
Document ParsingOmniDocBench ZH v1.0
Overall Edit0.126
15
Document ParsingOmniDocBench EN v1.0
Overall Edit Distance0.105
15
Document ParsingOmniDocBench Scanning Real5
Overall Score94.33
13
Formula RecognitionOmniDocBench Formula v1.5
CDM94.04
11
OCR Text RecognitionOmniDocBench
NED (ALL avg)0.026
10
Text recognitionOmniDocBench v1.6 (Full)
Edit Distance1.9
9
Showing 25 of 46 rows