Standard CL Benchmark
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Continual Learning | Standard CL Benchmark | Avg Final Acc0.811 | 71 | |
| Continual Learning | Standard CL benchmark (Yelp, Amazon, DBpedia, Yahoo, AG News) latest (test) | Accuracy (CL Suite Test)80 | 57 | |
| Continual Learning | Standard CL Benchmark | BWT (Avg Order 1-3)80.28 | 38 | |
| Continual Learning | Standard CL Benchmark | BWT0 | 11 | |
| Continual Learning | Standard CL Benchmark (SC) | Order 1 Accuracy78.87 | 9 | |
| Continual Learning Classification | Standard CL benchmark (4 tasks) | Average Accuracy (AA)88.25 | 9 | |
| Continual Learning | Standard CL Benchmark Order-2 | Accuracy78.8 | 9 | |
| Language Model Continual Learning | Standard CL Benchmark Order 1 | Average Performance77.24 | 6 | |
| Continual Learning | Standard CL Benchmark | MOPD9.84 | 4 | |
| Continual Learning | Standard CL Benchmark Average | Accuracy78.6 | 3 | |
| Continual Learning | Standard CL Benchmark Order-3 | Accuracy78.4 | 3 | |
| Continual Learning | Standard CL Benchmark Order-1 | Accuracy78.7 | 3 | |
| Continual Learning | Standard CL Benchmark | FLOPs0.125 | 3 |
Showing 13 of 13 rows