synthetic probes
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Candidate-ranking retrieval | 8192-token synthetic probes Weighted average | Accuracy50.6 | 4 | |
| Candidate-ranking retrieval | 8192-token synthetic probes Semantic paraphrase+distractor | Accuracy16.7 | 4 | |
| Candidate-ranking retrieval | synthetic probes Semantic paraphrase 8192-token | Accuracy50 | 4 | |
| Candidate-ranking retrieval | Synthetic probes 8192-token Semantic exact | Accuracy52.1 | 4 | |
| Candidate-ranking retrieval | 8192-token synthetic probes Bridge-window | Accuracy59.9 | 4 |
Showing 5 of 5 rows