Our new X account is live! Follow @wizwand_team for updates

Question Answering on HybridQA (dev)

68.4EM (Total)

S3HQA

Updated 4d ago

Evaluation Results

Method	Links
S3HQA 2024.02		68.4	-	-	70.3	75.3	69.9	78.2	75.3
MAFID 2024.02		66.2	-	-	69.4	75.2	66.5	75.5	74.1
MITQA 2024.02		65.5	-	-	68.1	73.3	66.7	75.6	72.7
POINTR 2024.02		63.4	-	-	68.6	74.2	62.8	71.9	71
POINTR + MATE 2021.09		63.4	-	-	68.6	74.2	62.8	71.9	71
POINTR + TAPAS 2021.09		63.3	-	-	68.1	73.9	62.9	72	70.8
POINTR + SAT 2021.09		61.2	-	-	66.5	71.8	60.3	69.2	68.7
POINTR + LINFORMER 2021.09		60.8	-	-	65.5	71.1	59.4	69	68.4
MuGER2 2024.02		57.1	-	-	60.9	69.2	56.9	68.9	67.3
HPROPRO 2024.02		48	-	-	51.4	55.9	46.8	54.4	54.6
HYBRIDER 2024.02		44	-	-	54.3	61.4	39.1	45.7	50.7
HYBRIDER 2021.09		44	-	-	54.3	61.4	39.1	45.7	50.7
POINTR + TABLEETC 2021.09		36.1	-	-	36	42.4	37.8	45.3	42.9
Unsupervised-QG 2024.02		25.7	-	-	-	-	-	-	30.5
GPT-4 End-to-End QA w. Retriever 2024.02		24.5	-	-	50	61.8	11.1	13.3	30
Passage-Only 2021.09		19.5	-	-	9.2	13.5	26.1	32.4	25.1
Table-Only 2021.09		8.4	-	-	14.7	19.1	2.4	4.5	12.1
Retrieval + ETC 2021.06		-	37	43.5	-	-	-	-	-
Sequential (ETC) 2021.06		-	39.4	44.8	-	-	-	-	-
Hybrider 2021.06		-	44	50.7	-	-	-	-	-
DOCHOPPER 2021.06		-	47.7	55	-	-	-	-	-
DOCHOPPER 2021.06		-	44.4	51.2	-	-	-	-	-
DOCHOPPER 2021.06		-	44.2	50.9	-	-	-	-	-
DOCHOPPER 2021.06		-	36.7	43.7	-	-	-	-	-
DOCHOPPER 2021.06		-	27.8	34.1	-	-	-	-	-
DOCHOPPER 2021.06		-	53.1	61.4	-	-	-	-	-
MATE 2021.06		-	63.4	71	-	-	-	-	-
HYBRIDER 2021.09		-	43.7	50.9	-	-	-	-	-
HYBRIDER 2021.09		-	44	50.7	-	-	-	-	-
TAPAS+ROBERTa 2021.09		-	57.3	64	-	-	-	-	-
ReasonBERT 2021.09		-	60.3	67.2	-	-	-	-	-