Prime
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Process-outcome alignment | PRIME Average | Outcome Score91.81 | 34 | |
| Process-outcome alignment | PRIME Biology | Outcome Score91.94 | 34 | |
| Process-outcome alignment | PRIME Chemistry | Outcome Score93.35 | 34 | |
| Process-outcome alignment | PRIME Physics | Outcome Score92.41 | 34 | |
| Process-outcome alignment | PRIME Math | Outcome Score92.44 | 34 | |
| Knowledge Graph Retrieval | Prime (test) | H@167.8 | 33 | |
| Gleason Score Classification | PRIME Synthetic Distortion (test) | Accuracy58.33 | 8 | |
| PI-RADS Score Classification | PRIME Synthetic Distortion (test) | Accuracy60 | 8 | |
| Autoformalization | PRIME | Success Count (SC)80.13 | 7 | |
| PI-QUAL score assessment | PRIME | B-ACC72.85 | 6 | |
| DWI Distortion assessment | PRIME | Balanced Accuracy69.75 | 6 | |
| Gleason Score Classification | PRIME Real Distortion (test) | Accuracy56.43 | 6 | |
| PI-RADS Score Classification | PRIME Real Distortion (test) | Accuracy (ACC)54.29 | 6 | |
| Question Answering | Prime (test) | Win Ratio56.5 | 2 |
Showing 14 of 14 rows