Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Information Retrieval on EntityQuestions (test)
Loading...
74.5
Recall@20 (macro average)
SPAR-PAQ (PAQ A + DPR-multi)
43.924
51.862
59.8
67.738
Mar 9, 2023
Recall@20 (macro average)
Recall@20
Updated 4d ago
Evaluation Results
Method
Method
Links
Recall@20 (macro average)
Recall@20
SPAR-PAQ (PAQ A + DPR-multi)
Modeling=Dense, # LM=4...
2023.03
74.5
-
SPAR-Wiki (Wiki A + DPR-multi)
Modeling=Dense, # LM=4...
2023.03
73.9
-
BM25
Modeling=Sparse
2023.03
72
-
PAQ A
Modeling=Dense, # LM=2...
2023.03
69.9
-
Wiki A
Modeling=Dense, # LM=2...
2023.03
69
-
Zero-NeR
Modeling=Dense, # LM=1...
2023.03
67.1
-
Contriever
Modeling=Dense, # LM=2...
2023.03
64.7
-
DPR-PAQ (SPAR checkpoint)
Modeling=Dense, # LM=2...
2023.03
63
-
DPR-PAQ (Sciavolino et al. 2021)
Modeling=Dense, # LM=2...
2023.03
59.3
-
DPR-multi
Modeling=Dense, # LM=2...
2023.03
56.7
-
DPR-NQ
Modeling=Dense, # LM=2...
2023.03
45.1
-
DPR
retrieval unit=passages
2021.10
-
65.4
BM25
retrieval unit=passages
2021.10
-
71.2
TOME-1
retrieval unit=mention...
2021.10
-
83.3
TOME-2
retrieval unit=mention...
2021.10
-
83.8
Feedback
Search any
task
Search any
task