| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Document Question Answering | LongDocURL | Accuracy (All)71.4 | 30 | |
| Multimodal Document Question Answering | LongDocURL | Overall Acc60.7 | 21 | |
| Retrieval | LongDocURL | Recall77.02 | 18 | |
| Long-context Document Understanding | LongDocURL | Accuracy64.5 | 14 | |
| Document Understanding | LongDocURL | Accuracy64.5 | 12 | |
| Retrieval | LongDocURL Filtered | MRR@1058.3 | 6 | |
| Visual Document Question Answering | LongDocURL (Filtered) | Accuracy67.79 | 5 |