Relevance Judgment Agreement on TREC-DL 2019 (test)
0.499Cohen's Kappa
UMBRELA
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.01 | 0.499 | |
2026.01 | 0.463 | |
2026.01 | 0.454 | |
2026.01 | 0.443 | |
2026.01 | 0.407 | |
2026.01 | 0.4 | |
2026.01 | 0.398 | |
2026.01 | 0.391 | |
2026.01 | 0.35 |
UMBRELA
| Method | Links | |
|---|---|---|
2026.01 | 0.499 | |
2026.01 | 0.463 | |
2026.01 | 0.454 | |
2026.01 | 0.443 | |
2026.01 | 0.407 | |
2026.01 | 0.4 | |
2026.01 | 0.398 | |
2026.01 | 0.391 | |
2026.01 | 0.35 |