StackOverflow
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Event Prediction | StackOverFlow | ACC49.6 | 58 | |
| Event Prediction | STACKOVERFLOW (test) | OTD10.341 | 55 | |
| Open intent recognition | StackOverflow | Accuracy88.98 | 54 | |
| Short Text Clustering | StackOverflow | Accuracy83.3 | 38 | |
| Generalized Category Discovery | StackOverflow (test) | Accuracy89.4 | 28 | |
| New Intent Discovery | StackOverflow | NMI80.73 | 27 | |
| Next Word Prediction | Stackoverflow (test) | Test Accuracy99 | 22 | |
| Helpfulness prediction | StackOverflow user-disjoint | Main Score69.2 | 20 | |
| Marked Temporal Point Process | StackOverflow (test) | RMSE0.948 | 20 | |
| Reranking | StackOverflow (test) | MAP40.92 | 16 | |
| Multi-horizon forecasting | StackOverflow | Inter-event Time RMSE0.825 | 15 | |
| Clustering | StackOverflow (test) | ARI52.59 | 14 | |
| Clustering | StackOverflow | NMI78.8 | 13 | |
| Question Retrieval | StackOverflow-Tag | Recall@10.498 | 12 | |
| Document Retrieval | StackOverflow (test) | Precision@559.2 | 11 | |
| Topic Modeling | StackOverflow | Cv0.397 | 11 | |
| Unknown Intent Detection | StackOverflow 50% seen classes (test) | Accuracy86.4 | 11 | |
| Classification | Stackoverflow (test) | Accp > Accg Percentage92.74 | 8 | |
| Event Time Prediction | StackOverflow | RMSE1.12 | 7 | |
| Unknown Intent Detection | StackOverflow 75% seen classes (test) | Accuracy81.71 | 6 | |
| Unknown Intent Detection | StackOverflow 25% seen classes (test) | Accuracy68.74 | 6 | |
| Open Intent Classification | StackOverflow 75% known classes (test) | Accuracy82.78 | 5 | |
| Open Intent Classification | StackOverflow 25% known classes (test) | Accuracy86.72 | 5 | |
| Data Transformation | StackOverflow | Accuracy65.3 | 3 | |
| SQL-to-text generation | Stackoverflow | BLEU-423.3 | 3 |
Showing 25 of 25 rows