GRAFITE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Underspecified Prompting | GRAFITE Sample | Pass Rate16.7 | 4 | |
| Table Processing | GRAFITE Sample Dataset Table | Pass Rate54.5 | 4 | |
| Summarization | GRAFITE Sample | Pass Rate83.3 | 4 | |
| Reasoning | GRAFITE Sample Reasoning | Pass Rate83.3 | 4 | |
| Multilingual | GRAFITE Multilingual Sample Dataset | Pass Rate40 | 4 | |
| Mathematics | GRAFITE Math Sample | Pass Rate60 | 4 | |
| Instruction Following | GRAFITE Sample Instruction Following | Pass Rate58.3 | 4 | |
| Factual Analysis | GRAFITE Sample Factual | Pass Rate29.4 | 4 | |
| Creative Writing | GRAFITE Sample Dataset Creative | Pass Rate100 | 4 | |
| Code | GRAFITE Sample Code | Pass Rate100 | 4 | |
| Multi-domain evaluation | GRAFITE Sample Dataset (Total) | Pass Rate63.2 | 4 |
Showing 11 of 11 rows