LRA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Long sequence classification | LRA (Long Range Arena) (test) | Average Accuracy87.09 | 92 | |
| Text Classification | LRA Text (test) | Throughput (Steps/s)17.7 | 32 | |
| Long-range sequence modeling | LRA 92 (test) | ListOps Accuracy63.14 | 26 | |
| Classification | LRA Image N=1024 (test) | Accuracy87.3 | 23 | |
| Image Classification | LRA reimplementation (test) | Running Time (h)2.19 | 9 | |
| Retrieval | LRA Document Retrieval reimplementation (test) | Running Time (h)1.13 | 9 | |
| ListOps | LRA ListOps (test) | Running Time (h)0.6 | 9 | |
| Text Classification | LRA Text Classification reimplementation (test) | Running Time (Hours)0.65 | 9 | |
| Text Retrieval | LRA Text Retrieval @8000 | Accuracy80.9 | 8 | |
| Document Retrieval | LRA Retrieval | Accuracy82.3 | 8 | |
| Text Classification | LRA Text | Accuracy68.4 | 8 | |
| Sequence Modeling | LRA ListOps | Accuracy38.36 | 8 | |
| Long-Range Retrieval | LRA Benchmark | ListOps Accuracy67.9 | 4 |
Showing 13 of 13 rows