ChemBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Chemical knowledge and reasoning | ChemBench | Overall Score86.1 | 11 | |
| In-Context Learning | ChemBench | Accuracy58.4 | 6 | |
| Science | ChemBench | Score83.3 | 3 | |
| Chemistry Question Answering | ChemBench Overall | Success90.5 | 1 | |
| Chemistry Question Answering | ChemBench Toxicity and Safety | Success Rate90.1 | 1 | |
| Chemistry Question Answering | ChemBench Technical Chemistry | Success Rate0.825 | 1 | |
| Chemistry Question Answering | ChemBench Physical Chemistry | Success8,420 | 1 | |
| Chemistry Question Answering | ChemBench Organic Chemistry | Success92.1 | 1 | |
| Chemistry Question Answering | ChemBench Materials Science | Success Rate90.5 | 1 | |
| Chemistry Question Answering | ChemBench Inorganic Chemistry | Success Rate91.3 | 1 | |
| Chemistry Question Answering | ChemBench General Chemistry | Success Rate0.872 | 1 | |
| Chemistry Question Answering | ChemBench Chemical Preference | Success Rate93.1 | 1 | |
| Chemistry Question Answering | ChemBench Analytical Chemistry | Success Rate82.2 | 1 |
Showing 13 of 13 rows