| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| WordSim-353 | ROOTROOT-CA | Spearman Rho0.7 | 114 | 2mo ago | |
| MEN | Omni TM-AE | Spearman Rho0.596 | 74 | 23d ago | |
| WS-353 | Ours (+post-process) | Spearman Correlation (WS-353)0.789 | 54 | 3mo ago | |
| RG-65 | Ours (+post-process) | Spearman Correlation0.851 | 41 | 1mo ago | |
| RG-65 (test) | Flan-T5-SD | Spearman Correlation0.848 | 33 | 3mo ago | |
| SimLex-999 | Ours (+post-process) | Spearman Correlation55.2 | 31 | 1mo ago | |
| SimLex999 (test) | AUXGAN | Spearman Correlation0.789 | 30 | 3mo ago | |
| WS-353 REL (test) | Ours (+post-process) | Spearman Correlation0.701 | 28 | 3mo ago | |
| SimVerb-3500 (test) | POST-DFFN | Spearman Correlation0.764 | 27 | 3mo ago | |
| WS-353 (test) | GloVe + Whitening | Spearman Correlation0.8231 | 18 | 3mo ago | |
| WS-353 SIM (test) | Spearman Correlation0.807 | 15 | 3mo ago | ||
| Mechanical Turk-771 | ROOTROOT-CA | Spearman ρ0.669 | 14 | 23d ago | |
| WS-353 SIM | W2V*text8 | Spearman Correlation0.66 | 12 | 23d ago | |
| MTurk-287 | GloVe+GT | Spearman Correlation0.62 | 12 | 23d ago | |
| English SimVerb-3500 Disjoint setting (test) | AUXGAN | Spearman's Rho0.552 | 12 | 3mo ago | |
| English SimLex-999 Disjoint setting (test) | AUXGAN | Spearman's Rho0.652 | 12 | 3mo ago | |
| WS353 EN | cbow | Spearman Correlation73 | 10 | 3mo ago | |
| EN RW | sisg | Spearman Correlation48 | 10 | 3mo ago | |
| RG65 FR | sisg- | Spearman Correlation75 | 8 | 3mo ago | |
| WS353 ES | sisg | Spearman Correlation54 | 8 | 3mo ago | |
| DE ZG222 | sisg | Spearman Correlation0.44 | 8 | 3mo ago | |
| DE GUR350 | sisg | Spearman Correlation73 | 8 | 3mo ago | |
| Rare Word (RW) | Ours (+post-process) | Spearman Correlation44 | 7 | 3mo ago | |
| WS-353 ALL (test) | Flan-T5-SD | Spearman Correlation0.739 | 7 | 3mo ago | |
| Word-similarity Suite Avg. | FastText | Spearman Correlation (ρ)0.55 | 6 | 23d ago |