OmniDocBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Document Parsing | OmniDocBench v1.5 | Overall Score94.1 | 126 | |
| Reading Order Detection | OmniDocBench ZH v1.0 | Edit Distance0.055 | 28 | |
| Reading Order Detection | OmniDocBench EN v1.0 | Edit Distance0.038 | 28 | |
| Document Parsing | OmniDocBench 1.5 (test) | Overall Score94.5 | 27 | |
| OCR-related Parsing Tasks | OmniDocBench English | Edit Distance0.032 | 23 | |
| Reading Order Detection | OmniDocBench v1.5 | Edit Distance0.043 | 21 | |
| Document Parsing | OmniDocBench Real5 warping | Overall Score91.25 | 19 | |
| Document Parsing | OmniDocBench Real5 illumination | Overall Score0.9216 | 19 | |
| Document Parsing | OmniDocBench Real5 skewing variation | Overall Score91.66 | 19 | |
| Document Parsing | Real5-OmniDocBench scanning scenario 1.5 (test) | Overall Score93.43 | 19 | |
| Document Parsing | Real5-OmniDocBench 5-distortion types (test) | Overall Accuracy92.05 | 19 | |
| Document Parsing | Real5-OmniDocBench (screen-photography) | Overall Score91.76 | 19 | |
| Document Parsing | OmniDocBench ZH v1.0 | Overall Edit0.126 | 15 | |
| Document Parsing | OmniDocBench EN v1.0 | Overall Edit Distance0.105 | 15 | |
| Document Parsing | OmniDocBench v1.5 | Total Time (s)944.4 | 9 | |
| OCR-related Parsing Tasks | OmniDocBench Chinese | Edit Distance0.281 | 7 | |
| Document Parsing | OmniDocBench v1.5 | AAL1.96 | 6 | |
| Document & Chart Understanding | OmniDocBench | NED29.47 | 5 | |
| Document Parsing | OmniDocBench | Overall Accuracy90.41 | 4 | |
| Formula Recognition | OmniDocBench Formula v1.5 | CDM92.3 | 4 | |
| Document Parsing | OmniDocBench v1.5 (test) | Latency (s/page)1.48 | 4 | |
| Speculative Decoding Acceleration | OmniDocBench > 8192 tokens v1.5 | AAL (Overall)4.98 | 2 |
Showing 22 of 22 rows