Relevance Judgment Agreement on TREC-DL 2019
0.499Cohen's Kappa
UMBRELA
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.01 | 0.499 | |
2026.01 | 0.459 | |
2026.01 | 0.452 | |
2026.01 | 0.429 | |
2026.01 | 0.425 | |
2026.01 | 0.389 | |
2026.01 | 0.386 |
UMBRELA
| Method | Links | |
|---|---|---|
2026.01 | 0.499 | |
2026.01 | 0.459 | |
2026.01 | 0.452 | |
2026.01 | 0.429 | |
2026.01 | 0.425 | |
2026.01 | 0.389 | |
2026.01 | 0.386 |