| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Retrieval | LongDocURL | Recall77.02 | 30 | |
| Document Question Answering | LongDocURL | Accuracy (All)71.4 | 30 | |
| Multimodal Document Question Answering | LongDocURL | Overall Acc65.7 | 28 | |
| Document Question Answering | LongDocURL (test) | Accuracy55.52 | 16 | |
| Long-context Document Understanding | LongDocURL | Accuracy64.5 | 14 | |
| Document Understanding | LongDocURL | Accuracy64.5 | 12 | |
| Document Understanding | LongDocURL | Accuracy (TXT)65.1 | 8 | |
| Retrieval | LongDocURL Filtered | MRR@1058.3 | 6 | |
| LongContext Understanding | LongDocURL | Pass@175.1 | 5 | |
| Visual Document Question Answering | LongDocURL (Filtered) | Accuracy67.79 | 5 |