ChemProt
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| High-stakes specialized classification | ChemProt (test) | Macro F159.09 | 49 | |
| Relation Extraction | ChemProt | Micro F184.62 | 40 | |
| Relation Extraction | ChemProt (test) | Micro F183.64 | 25 | |
| Relation Classification | Chemprot | Accuracy79.65 | 13 | |
| Relation Extraction | ChemProt | F1 Score83.64 | 10 | |
| Text Classification | ChemProt real-world noise | Accuracy70.98 | 8 | |
| Relation Classification | CHEMPROT (test) | Score0.76 | 6 | |
| Text Classification | Chemprot | Label Quality45.5 | 5 | |
| Relation Extraction | CHEMPROT macro-averaged (test) | Precision52.74 | 5 | |
| High-stakes specialized classification | ChemProt (val) | Macro F160.59 | 4 | |
| Continued Pretraining | ChemProt (test) | Micro F185.04 | 4 | |
| Text Classification | ChemProt (test) | Micro F184.49 | 4 | |
| Named Entity Recognition | ChemProt (val) | Micro F178.5 | 1 |
Showing 13 of 13 rows