STS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Semantic Textual Similarity | STS tasks (STS12, STS13, STS14, STS15, STS16, STS-B, SICK-R) | STS12 Score80.67 | 253 | |
| Semantic Textual Similarity | STS-12 | Spearman Correlation (rho)0.7154 | 91 | |
| Semantic Textual Similarity | English STS | Average Score83.07 | 68 | |
| Semantic Textual Similarity | STS (Semantic Textual Similarity) 2012-2016 (test) | STS-12 Score81.08 | 57 | |
| Semantic Textual Similarity | STS Benchmark (test) | Pearson Correlation (r)0.919 | 46 | |
| Semantic Textual Similarity | STS16 (test) | Spearman Corr77.18 | 42 | |
| Semantic Textual Similarity | STS15 (test) | Spearman Correlation0.8049 | 42 | |
| Semantic Textual Similarity | STS14 (test) | Spearman Correlation0.7319 | 42 | |
| Semantic Textual Similarity | STS13 (test) | Spearman Correlation81.26 | 42 | |
| Semantic Textual Similarity | STS 2014 | Spearman Correlation66.93 | 39 | |
| Semantic Textual Similarity | STS12 (test) | Similarity Score65.31 | 30 | |
| Sentence Relatedness | STS 2014 | News Spearman0.69 | 30 | |
| Privacy-utility tradeoff | STS12 | Leakage4.34 | 16 | |
| Semantic Textual Similarity | STS-16 | Spearman Rho (x100)77.63 | 16 | |
| Semantic Textual Similarity | STS-13 | Spearman's Rho76.52 | 16 | |
| Semantic Textual Similarity | STS-15 | Spearman's Rho0.7662 | 15 | |
| Semantic Textual Similarity | STS22 | Pearson Correlation76.55 | 14 | |
| Semantic Textual Similarity | STS hye | Score71.23 | 13 | |
| Medical Image Segmentation | STS X-ray (unseen) | DSC73.2 | 10 | |
| Lung tumor segmentation | STS (test) | IoU60.33 | 9 | |
| Semantic Textual Similarity | STS English (test) | Spearman's ρ76.9 | 9 | |
| Semantic Textual Similarity | STS SemEval-2017 Task 1 (test) | Pearson Correlation0.744 | 8 | |
| Semantic Textual Similarity | STS12 | Downstream Performance74.25 | 5 | |
| Semantic Textual Similarity | STS13 | MRL84.03 | 4 | |
| Transfer Learning Evaluation | STS Transfer Robustness (test val) | MRPC62.2 | 4 |
Showing 25 of 33 rows