Relevance Judgment Agreement on TREC-DL 2021
0.492Cohen's Kappa
UMBRELA
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.01 | 0.492 | |
2026.01 | 0.476 | |
2026.01 | 0.469 | |
2026.01 | 0.455 | |
2026.01 | 0.402 | |
2026.01 | 0.343 | |
2026.01 | 0.34 |
UMBRELA
| Method | Links | |
|---|---|---|
2026.01 | 0.492 | |
2026.01 | 0.476 | |
2026.01 | 0.469 | |
2026.01 | 0.455 | |
2026.01 | 0.402 | |
2026.01 | 0.343 | |
2026.01 | 0.34 |