Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LRA ListOps

Benchmarks

Task NameDataset NameSOTA ResultTrend
ClassificationLRA ListOps N=2000 (test)
Accuracy61.48
39
Logical Expression EvaluationLRA ListOps Length 2000 Arguments 10
Accuracy80.1
11
Long Range Arena ListOpsLRA-ListOps small
Accuracy (LRA-ListOps small)71.9
6
List OperationsLRA-ListOps (val)
Accuracy36.1
5
Sequence ClassificationLRA ListOps T=2,048 (val)
Accuracy36.37
4
Showing 5 of 5 rows