DUDE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Document Retrieval | DUDE | Recall@125.17 | 32 | |
| Document Understanding | DUDE | Accuracy61.8 | 32 | |
| Document Visual Question Answering | DUDE | ANLS60 | 30 | |
| Document Question Answering | DUDE | Accuracy (all)80.7 | 23 | |
| Multi-page Document Question Answering | DUDE | ANLS56.1 | 23 | |
| Document Question Answering | DUDE (test) | ANLS65.931 | 22 | |
| Multi-page Document Understanding | DUDE | ANLS64.5 | 21 | |
| Question Answering | DUDE | ANLS21.43 | 13 | |
| Reasoning over rich modalities | DUDE | Accuracy52.7 | 12 | |
| Document Question Answering | DUDE | ANLS0.5809 | 12 | |
| OCR error correction | DUDE | Win Rate92 | 7 | |
| Visual Question Answering | DUDE (test) | ANLS0.546 | 4 | |
| Document Question Answering | DUDE | TFLOPS (ENC)9.9 | 2 |
Showing 13 of 13 rows