AG News
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text Classification | AG News (test) | Accuracy94.7 | 326 | |
| Text Classification | AG-NEWS | Accuracy94.1 | 248 | |
| Topic Classification | AG-News | Accuracy95.58 | 228 | |
| Topic Classification | AG News (test) | Accuracy94.91 | 128 | |
| Text Classification | AG News (Fourth Session Transition) | Accuracy77.18 | 48 | |
| Text Classification | AG News (Second Session Transition) | Accuracy76.27 | 48 | |
| News Classification | AG News (test) | Accuracy91.7 | 48 | |
| Language Modeling | AG News | PPL4.76 | 45 | |
| Text Classification | AG NEWS RoBERTa-large (test) | CACC95.6 | 44 | |
| Membership Inference Attack | AG News (test) | AUC0.909 | 43 | |
| Text Classification | AG News | Classification Accuracy (CA)96.15 | 39 | |
| Counterfactual Generation | AG News | LFR0.915 | 37 | |
| Language Modeling | AG News (val) | Perplexity18.19 | 36 | |
| Multi-class text classification | AG News | Micro-F10.917 | 33 | |
| Counterfactual Generation | AG News (test) | SLFR98 | 29 | |
| Text Adversarial Example Detection | Ag-News | TPR@10100 | 28 | |
| Text Classification | AG News | Accuracy94.5 | 26 | |
| Text Anomaly Detection | NLPAD-AGNews | AUROC94.84 | 25 | |
| Faithfulness Evaluation | AG-news (test) | Rate of Label Changes2 | 24 | |
| Triplet Alignment | AG-News | Triplet Alignment Accuracy (AG-News)85.9 | 24 | |
| Adversarial Text Detection | AG News | F1 Score96.7 | 24 | |
| Language Modeling | AG News zero-shot | Perplexity52.09 | 22 | |
| Concept Learning | AG News | Training Time234 | 21 | |
| Text embedding | AG News | t-value54.63 | 20 | |
| Text Classification | AG News 40 labels | Top-1 Error Rate0.1067 | 19 |
Showing 25 of 116 rows