Share your thoughts, 1 month free Claude Pro on usSee more

Relevance Assessment Label Alignment on Robust 2004

0.56Cohen's Kappa (κ)

TREC Topic (Baseline)

Updated 12d ago

Evaluation Results

Method	Links
TREC Topic (Baseline) 2026.04		0.56	0.4	43	33	24
query-contrastive 2026.04		0.44	0.49	50	36	14
query-contrastive 2026.04		0.44	0.49	51	36	13
query-contrastive 2026.04		0.44	0.49	51	36	13
query-contrastive 2026.04		0.43	0.51	51	36	13
query-contrastive 2026.04		0.42	0.51	53	36	12
query-docs-pos 2026.04		0.38	0.55	54	39	7
query-docs-pos 2026.04		0.36	0.57	57	35	7
query-docs-neg 2026.04		0.33	0.6	61	33	6
query-docs-neg 2026.04		0.32	0.62	63	32	6
query 2026.04		0.31	0.61	60	36	3