Natural Language Understanding on GLUE 1.0 (test)
66.4CoLA (MCC)
Human Performance
Updated 4d ago
Evaluation Results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2019.04 | 66.4 | 97.8 | 86.3 | 80.8 | 92.7 | 92.6 | 59.5 | 80.4 | 92 | 92.8 | 91.2 | 93.6 | 95.9 | - | 87.1 | |
2019.04 | 65.4 | 95.6 | 91.1 | 88.2 | 89.6 | 89 | 72.7 | 89.6 | 87.5 | 86.7 | 96 | 85.1 | 65.1 | 42.8 | 83.7 | |
2019.04 | 63.8 | 96.2 | 91.5 | 88.5 | 90.1 | 89.7 | 73.1 | 89.9 | 87.6 | 87.2 | 93.9 | 80.9 | 65.1 | 39.9 | 83.2 | |
2021.07 | 63.8 | 95.4 | 90.7 | - | 90.1 | - | 72.1 | - | 87.7 | 87.1 | 93.6 | 80.4 | - | - | 84.5 | |
2019.04 | 63.5 | 95.2 | 91.8 | 89 | 89.8 | 88.8 | 74 | 90.4 | 87.9 | 87.4 | 95.7 | 80.9 | 65.1 | 40.7 | 83.3 | |
2019.04 | 61.5 | 95.6 | 90 | 86.7 | 88.3 | 87.7 | 72.4 | 89.6 | 86.7 | 86 | - | 75.5 | 65.1 | 40.3 | 82.2 | |
2019.04 | 60.5 | 94.9 | 89.3 | 85.4 | 87.6 | 86.5 | 72.1 | 89.3 | 86.7 | 85.9 | 92.7 | 70.1 | 65.1 | 39.6 | 80.5 | |
2021.07 | 60.5 | 94.9 | 89.3 | - | 86.5 | - | 72.1 | - | 86.7 | 85.9 | 92.7 | 70.1 | - | - | 82.1 | |
2021.07 | 59.5 | 95.1 | 90.5 | - | 88.9 | - | 72.8 | - | 86.1 | 86 | 92.1 | 80.2 | - | - | 83.5 | |
2021.07 | 55.9 | 94.6 | 89.5 | - | 88.3 | - | 71.8 | - | 85.4 | 84.9 | 91.2 | 77.8 | - | - | 82.2 | |
2021.07 | 54.9 | 93 | 87.9 | - | 84.4 | - | 72.1 | - | 84.5 | 84.1 | 91.3 | 69.9 | - | - | 80.2 | |
2021.07 | 53.7 | 93.5 | 89.3 | - | 86.1 | - | 71.3 | - | 84.6 | 83.6 | 90.1 | 72.1 | - | - | 80.5 | |
2021.07 | 52.1 | 93.5 | 88.9 | - | 85.8 | - | 71.2 | - | 84.6 | 83.4 | 90.5 | 66.4 | - | - | 79.6 | |
2021.07 | 50.5 | 94.6 | 90 | - | 88.1 | - | 70.9 | - | 86 | 85.4 | 92.5 | 73 | - | - | 81.1 | |
2019.04 | 47.2 | 93.1 | 87.7 | 83.7 | 85.3 | 84.8 | 70.1 | 88.1 | 80.8 | 80.6 | - | 69.1 | 65.1 | 29.4 | 76.9 | |
| 45.4 | 91.3 | 82.3 | 75.7 | 82 | 80 | 70.3 | 88.5 | 82.1 | 81.4 | 87.4 | 56 | 53.4 | 29.8 | 72.8 | ||
2021.07 | 45.4 | 91.3 | 82.3 | - | 82 | - | 70.3 | - | 82.1 | 81.4 | 88.1 | 56 | - | - | 75.4 | |
2022.03 | 40.72 | 90.25 | - | - | - | - | - | 87.13 | 80 | 80.41 | - | - | - | - | - | |
2022.03 | 40.11 | 90.71 | - | - | - | - | - | 84.32 | 69.64 | 69.57 | - | - | - | - | - | |
2022.03 | 38.45 | 90.25 | - | - | - | - | - | 84.35 | 69.36 | 68.8 | - | - | - | - | - | |
2019.04 | 36 | 90.4 | 84.9 | 77.9 | 75.1 | 73.3 | 64.8 | 84.7 | 76.4 | 76.1 | 79.8 | 56.8 | 65.1 | 26.5 | 70 | |
2022.03 | 34.79 | 89.33 | - | - | - | - | - | 84.27 | 69.35 | 68.72 | - | - | - | - | - | |
2022.03 | 17.07 | 84.98 | - | - | - | - | - | 84.01 | 73.73 | 74.63 | - | - | - | - | - | |
2022.03 | 10.14 | 88.3 | - | - | - | - | - | 84.07 | 69.36 | 69.11 | - | - | - | - | - | |
2022.03 | 8.67 | 87.5 | - | - | - | - | - | 83.97 | 69.53 | 69.5 | - | - | - | - | - |