Natural Language Understanding on SuperGLUE (WSC, WIC, RTE, CB, MultiRC, BoolQ, COPA, AVG)
57.69WSC Score
Pythia
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
2023.11 | 57.69 | 50.31 | 52.71 | 35.71 | 1.68 | 60.4 | 70 | 46.93 | |
2023.11 | 40.38 | 50 | 52.71 | 41.07 | 1.05 | 55.14 | 61 | 43.05 | |
2023.11 | 40.38 | 50.78 | 53.43 | 42.86 | 3.04 | 58.69 | 70 | 45.6 | |
2023.11 | 38.46 | 51.1 | 56.68 | 42.86 | 1.47 | 59.91 | 65 | 45.07 | |
2023.11 | 38.46 | 50.16 | 52.71 | 51.79 | 1.99 | 59.05 | 73 | 46.74 | |
2023.11 | 37.5 | 51.1 | 51.99 | 41.07 | 3.15 | 57.77 | 79 | 45.94 | |
2023.11 | 36.54 | 50 | 54.87 | 41.07 | 0.84 | 61.71 | 64 | 44.15 | |
2023.11 | 36.54 | 50 | 49.82 | 21.43 | 1.36 | 55.47 | 66 | 40.09 | |
2023.11 | 36.54 | 50.16 | 52.71 | 41.07 | 2.52 | 55.08 | 65 | 43.3 | |
2023.11 | 36.54 | 50 | 51.99 | 46.43 | 1.36 | 57.74 | 72 | 45.15 | |
2023.11 | 36.54 | 50 | 60.29 | 44.64 | 1.99 | 61.99 | 69 | 46.35 | |
2023.11 | 36.54 | 50 | 53.07 | 35.71 | 0.94 | 60.73 | 72 | 44.14 | |
2023.11 | 36.54 | 50 | 52.71 | 41.07 | 0.73 | 59.08 | 68 | 44.02 |