BRIGHT
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Information Retrieval | BRIGHT | Biology nDCG@1063.1 | 45 | |
| Information Retrieval | BRIGHT 1.0 (test) | nDCG@10 (Avg)37.9 | 35 | |
| Downstream retrieval | BRIGHT | Biology nDCG@520 | 24 | |
| Retrieval | BRIGHT 12 datasets aggregate (test) | NDCG@1012.74 | 20 | |
| Retrieval | BRIGHT | nDCG@1 (Econ)65.8 | 13 | |
| Passage Reranking | BRIGHT | NDCG@10 (Avg)38 | 12 | |
| Retrieval | BRIGHT v1 (leaderboard) | Average Retrieval Score46.8 | 12 | |
| Multi-class Classification | BRIGHT 6class (test) | Accuracy43.4 | 11 | |
| Building Damage Assessment | BRIGHT | F1 (bcd)91.71 | 10 | |
| Information Retrieval | BRIGHT v1 (test) | nDCG@10 (Bio)58.2 | 8 | |
| Reasoning-intensive Retrieval | BRIGHT | BRIGHT Score19.3 | 8 | |
| Information Retrieval | BRIGHT unseen 6 subsets (test) | nDCG@1011.79 | 7 | |
| Image Classification | BRIGHT (test) | Accuracy0.6458 | 3 |
Showing 13 of 13 rows