Share your thoughts, 1 month free Claude Pro on usSee more

Utility Judgment on TREC DL

63.18F1 Score

ITEM-As w. ExpA

Updated 4d ago

Evaluation Results

Method	Links
ITEM-As w. ExpA 2024.06		63.18
ITEM-As w. ExpA 2024.06		62.52
ITEM-ARs w. ExpA 2024.06		62
ITEM-ARs w. ExpA 2024.06		61.37
ITEM-As w. ImpA 2024.06		60.56
5-sampling 2024.06		60.49
ITEM-As w. ImpA 2024.06		58.11
UJ-ExpA 2024.06		57.49
ITEM-ARs w. ExpA 2024.06		56.27
UJ-ImpA 2024.06		56.18
ITEM-As w. ExpA 2024.06		56.03
ITEM-As w. ExpA 2024.06		55.74
Vanilla 2024.06		55.19
ITEM-As w. ImpA 2024.06		55.14
ITEM-As w. ImpA 2024.06		54.9
ITEM-As w. ExpA 2024.06		54.86
ITEM-As w. ImpA 2024.06		54.61
UJ-ExpA 2024.06		54.1
ITEM-As w. ExpA 2024.06		53.78
ITEM-As w. ImpA 2024.06		53.76
UJ-ExpA 2024.06		53.73
ITEM-As w. ImpA 2024.06		53.73
ITEM-As w. ImpA 2024.06		53.68
ITEM-As w. ExpA 2024.06		53.66
ITEM-As w. ExpA 2024.06		53.61
UJ-ExpA 2024.06		52.83
5-sampling 2024.06		52.68
ITEM-As w. ExpA 2024.06		52.46
ITEM-ARs w. ExpA 2024.06		52.34
5-sampling 2024.06		52.31
ITEM-ARs w. ExpA 2024.06		52.1
ITEM-As w. ExpA 2024.06		52.09
ITEM-As w. ImpA 2024.06		52.05
ITEM-As w. ExpA 2024.06		51.74
UJ-ImpA 2024.06		50.2
Vanilla 2024.06		49.84
ITEM-As w. ExpA 2024.06		49.44
Vanilla 2024.06		49.39
ITEM-As w. ImpA 2024.06		49.39
ITEM-ARs w. ExpA 2024.06		48.97
UJ-ImpA 2024.06		48.83
UJ-ImpA 2024.06		48.31
UJ-ImpA 2024.06		48.29
UJ-ImpA 2024.06		48.22
UJ-ExpA 2024.06		48.09
Vanilla 2024.06		47.64
ITEM-As w. ImpA 2024.06		46.59
ITEM-As w. ImpA 2024.06		46.01
Vanilla 2024.06		45.67
Vanilla 2024.06		45.11
UJ-ExpA 2024.06		43.53