StackOverflow
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Open intent recognition | StackOverflow | Accuracy88.98 | 54 | |
| Event Prediction | StackOverFlow | RMSE0.464 | 42 | |
| Short Text Clustering | StackOverflow | Accuracy83.3 | 38 | |
| Reranking | StackOverflow (test) | MAP40.92 | 16 | |
| Clustering | StackOverflow (test) | ARI52.59 | 14 | |
| Clustering | StackOverflow | NMI78.8 | 13 | |
| Document Retrieval | StackOverflow (test) | Precision@559.2 | 11 | |
| Topic Modeling | StackOverflow | Cv0.397 | 11 | |
| Unknown Intent Detection | StackOverflow 50% seen classes (test) | Accuracy86.4 | 11 | |
| Marked Temporal Point Process | StackOverflow (test) | Log-Likelihood-2.332 | 10 | |
| Next Word Prediction | Stackoverflow (test) | Generalized Accuracy (Accg)26.64 | 9 | |
| New Intent Discovery | StackOverflow | NMI78.71 | 8 | |
| Classification | Stackoverflow (test) | Accp > Accg Percentage92.74 | 8 | |
| Unknown Intent Detection | StackOverflow 75% seen classes (test) | Accuracy81.71 | 6 | |
| Unknown Intent Detection | StackOverflow 25% seen classes (test) | Accuracy68.74 | 6 | |
| Open Intent Classification | StackOverflow 75% known classes (test) | Accuracy82.78 | 5 | |
| Open Intent Classification | StackOverflow 25% known classes (test) | Accuracy86.72 | 5 | |
| Data Transformation | StackOverflow | Accuracy65.3 | 3 | |
| SQL-to-text generation | Stackoverflow | BLEU-423.3 | 3 |
Showing 19 of 19 rows