GLUE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Natural Language Understanding | GLUE | SST-2156 | 551 | |
| Natural Language Understanding | GLUE (dev) | SST-2 (Acc)97.36 | 529 | |
| Natural Language Understanding | GLUE (test) | SST-2 Accuracy97.9 | 416 | |
| Natural Language Understanding | GLUE (val) | SST-297.4 | 201 | |
| Natural Language Understanding | GLUE (test dev) | MRPC Accuracy93.45 | 90 | |
| General Language Understanding | GLUE | Accuracy92.5 | 75 | |
| Natural Language Understanding | GLUE (test) | QNLI7,564.6 | 64 | |
| Model Merging | GLUE CoLA, MRPC, RTE, SST-2 | Absolute Accuracy75.9 | 60 | |
| Natural Language Understanding | GLUE (test val) | MRPC Accuracy94 | 59 | |
| Natural Language Understanding | GLUE | SST-295.18 | 55 | |
| Natural Language Understanding | GLUE (test) | QNLI94.9 | 47 | |
| Natural Language Understanding | GLUE | COLA Score69.3 | 41 | |
| Natural Language Understanding | GLUE | SST-296 | 40 | |
| General Language Understanding | GLUE v1 (test dev) | MNLI87.86 | 40 | |
| Text Classification | GLUE | Accuracy (SST-2)89.1 | 33 | |
| Natural Language Understanding | GLUE (test) | SST-2 Accuracy95.64 | 33 | |
| Text Classification | GLUE | Accuracy94.1 | 32 | |
| Natural Language Understanding | GLUE small | CoLA Mcc73.4 | 32 | |
| Adversarial Attack | GLUE | SST-2 Speedup3.56 | 32 | |
| Natural Language Understanding | GLUE | SST-2 Speedup3.06 | 32 | |
| Natural Language Understanding | GLUE (test) | MNLI Score82.2 | 30 | |
| Natural Language Understanding | GLUE | Average GLUE Score100 | 30 | |
| Natural Language Understanding | GLUE | MRPC Score91.91 | 30 | |
| Natural Language Understanding | GLUE v1 (dev) | MRPC Score93.8 | 30 | |
| Natural Language Understanding | GLUE | SST-2 Acc97.5 | 28 |
Showing 25 of 188 rows
...