WiC
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Word Sense Disambiguation | WiC | Avg Accuracy74.5 | 84 | |
| Word-in-Context Classification | WiC | Accuracy70.1 | 34 | |
| Word Sense Disambiguation | WiC (dev) | Accuracy89.5 | 32 | |
| Word Sense Disambiguation | WiC (test) | Accuracy85.3 | 26 | |
| Word Sense Disambiguation | WiC v1.0 (test) | Accuracy72.1 | 19 | |
| Word Sense Disambiguation | WiC SuperGLUE (val) | Accuracy68.55 | 9 | |
| Word Sense Disambiguation | WiC SuperGLUE (test dev) | Accuracy0.72 | 8 | |
| Word Sense Disambiguation | WIC SuperGLUE (test) | Accuracy65.82 | 8 | |
| Word Sense Disambiguation | WiC | Accuracy (0-shot)57.1 | 6 |
Showing 9 of 9 rows