MRCR
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Long Context | MRCR | Score89.7 | 25 | |
| Long Context Understanding | MRCR | Accuracy75.3 | 15 | |
| Multi-needle Retrieval | MRCR | MRCR 2-Needle Success38 | 9 | |
| Multi-round coreference resolution | MRCR | 2-Needle Score81.6 | 8 | |
| Complex retrieval and positional sorting | MRCR 512K~1M | Score46.88 | 6 | |
| Complex retrieval and positional sorting | MRCR 128K~512K | Score53.98 | 6 | |
| Multi-Round Chat Retrieval | MRCR | Accuracy92.3 | 6 | |
| Multi-round Code Repair | MRCR | pass@10.77 | 5 |
Showing 8 of 8 rows