Open Question Answering on WEBQUESTIONS (test)

42.2F1 Score

Memory Networks

Updated 4d ago

Evaluation Results

Method
Memory Networks 2015.06	42.2	-	-	-	-	-
Memory Networks 2015.06	41.9	-	-	-	-	-
(Yang et al., 2014) 2015.06	41.3	-	-	-	-	-
Memory Networks 2015.06	41.2	-	-	-	-	-
Memory Networks 2015.06	41	-	-	-	-	-
Memory Networks 2015.06	41	-	-	-	-	-
Memory Networks 2015.06	40.4	-	-	-	-	-
Memory Networks 2015.06	40.1	-	-	-	-	-
(Berant and Liang, 2014) 2015.06	39.9	-	-	-	-	-
(Bordes et al., 2014a) – using path + subgraph 2015.06	39.2	-	-	-	-	-
Memory Networks 2015.06	36.2	-	-	-	-	-
(Bordes et al., 2014a) – using path 2015.06	35.3	-	-	-	-	-
(Berant et al., 2013) 2015.06	31.3	-	-	-	-	-
(Bordes et al., 2014b) 2015.06	29.7	-	-	-	-	-
Memory Networks 2015.06	28.2	-	-	-	-	-
Reinforced Ranker-Reader 2017.08	24.6	-	-	-	-	17.1
Memory Networks 2015.06	22.7	-	-	-	-	-
Simple Ranker-Reader 2017.08	22.5	-	-	-	-	15.6
Memory Networks 2015.06	22	-	-	-	-	-
Single Reader 2017.08	22	-	-	-	-	15.2
DrQA-MTL 2017.08	20.7	-	-	-	-	-
Memory Networks 2015.06	18.7	-	-	-	-	-
Emb.+fine-tuning+string-match. 2014.04	7.6	9.1	27	-	-	-
Emb. +string-match. 2014.04	6.8	8.5	24.6	-	-	-
Emb.+fine-tuning 2014.04	3.2	3.2	10.6	-	-	-
Emb. 2014.04	2.5	2.5	9.4	-	-	-
Random guess 2015.06	1.9	-	-	-	-	-
YodaQA 2017.03	-	39.8	-	-	-	-
DrQA 2017.03	-	11.8	-	-	-	-
DrQA 2017.03	-	19.5	-	-	-	-
DrQA 2017.03	-	20.7	-	-	-	-
DrQA 2017.08	-	-	-	-	-	19.5
YodaQA 2017.08	-	-	-	-	-	39.8
ORQA 2022.03	-	-	-	-	-	36.4
REALM 2022.03	-	-	-	-	-	40.7
C-MORE (DPR Architecture) 2022.03	-	-	-	-	-	4.5
BM25 2022.03	-	-	-	-	-	29.9
C-MORE (DPR Architecture) 2022.03	-	-	-	-	-	32.1
DPR 2022.03	-	-	-	-	-	34.6
C-MORE (DPR Architecture) 2022.03	-	-	-	-	-	35.6
C-MORE (DPR Architecture) 2022.03	-	-	-	-	-	38.6