GEM
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Grounded ECG Interpretation | GEM (test) | Diagnosis Accuracy83.3 | 18 | |
| Logical Reasoning | GEM mastermind v1 (test) | Pass@178.6 | 6 | |
| Logical reasoning and game playing | GEM | Sudoku pass@199.3 | 6 | |
| RDF-to-text generation | GEM2 Factual (test) | Grammaticality98.4 | 6 | |
| RDF-to-text generation | GEM2 Fictional (test) | Grammaticality93.7 | 6 |
Showing 5 of 5 rows