SciKnowEval
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Scientific Reasoning | SciKnowEval | Chemistry Accuracy82.38 | 47 | |
| Scientific Reasoning | SciKnowEval Chemistry | mean@1646.87 | 24 | |
| Scientific Reasoning | SciKnowEval Physics | Mean@1663.39 | 24 | |
| Scientific Reasoning | SciKnowEval Material | Mean@1671.48 | 24 | |
| Scientific Reasoning | SciKnowEval Biology | Mean@1637.08 | 24 | |
| Scientific Knowledge Evaluation | SciKnowEval | Accuracy52.1 | 12 | |
| Scientific reasoning | SciKnowEval Hard | Pass@142.4 | 5 | |
| Scientific reasoning | SciKnowEval Hardest | Pass@121 | 5 | |
| Scientific Reasoning | SciKnowEval (test) | Biology Accuracy65.38 | 4 | |
| Scientific Question Answering | SciKnowEval | Accuracy (Biology)55.69 | 4 |
Showing 10 of 10 rows