Wiki
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Modeling | Wiki | Perplexity (PPL)2 | 298 | |
| Language Generation | Wiki | Perplexity3.53 | 54 | |
| Multivariate Time Series Forecasting | Wiki | MAE0.041 | 32 | |
| eXtreme Multi-label Classification | Wiki 500K | P@181.26 | 30 | |
| Temporal Knowledge Graph Reasoning | WIKI | MRR0.4603 | 28 | |
| Graph Clustering | Wiki | ARI35.8 | 27 | |
| Entity Linking | WIKI (test) | Micro F184.5 | 27 | |
| Probabilistic Forecasting | wiki | CRPS0.214 | 25 | |
| Entity Disambiguation | WIKI (test) | Micro F189.2 | 24 | |
| Clustering | Wiki | Accuracy59.67 | 23 | |
| Node Classification | Wiki | Micro F10.5907 | 23 | |
| Relation Classification | Wiki ZSL (test) | Precision (%)71.54 | 22 | |
| Node Classification | wiki (test) | Accuracy65.13 | 22 | |
| Macroscopic time series forecasting | Wiki | SMAPE0.0362 | 20 | |
| Temporal Knowledge Graph Reasoning | WIKI (meta-test) | MRR33.5 | 19 | |
| Time series forecasting | wiki (test) | CRPS0.214 | 19 | |
| Definition Modeling | Wiki | BLEU62.07 | 18 | |
| Temporal Point Process modeling | Wiki real-world (test) | Negative Log-Likelihood-1.3727 | 18 | |
| Temporal Reasoning Prediction | WIKI (test) | Positive Performance99.28 | 17 | |
| Semantic Similarity | WIKI (test) | BLEU-455.52 | 17 | |
| TKG reasoning | WIKI (test) | MRR30.9 | 17 | |
| Clustering | Wiki | Clustering Time (s)0.12 | 16 | |
| Relation Extraction | Wiki ZSL (test) | Micro-F153.71 | 16 | |
| Link Prediction | WIKI | Hits@179.85 | 16 | |
| Extractive Question Answering | Wiki (test) | EM78.6 | 16 |
Showing 25 of 112 rows