Our new X account is live! Follow @wizwand_team for updates

Question Answering on MRQA 2019 (dev)

92.5SQuAD Score

SpanBERT

Updated 4d ago

Evaluation Results

Method	Links
SpanBERT 2021.09		92.5	79.9	80.7	71.1	84.8	80.7	81.6
Splinter 2021.09		92.4	79.7	80.3	70.8	84	80.6	81.3
Splinter* 2021.09		92.2	76.5	81	71.3	83	80.7	80.8
ROBERTa 2021.09		92	78.1	80.6	71.9	85.2	79.1	81.2
ReasonBERT_R 2021.09		91.4	78.9	80.8	71.4	85.3	80.6	81.4
SSPT 2021.09		91.1	77	80	69.7	83.3	79.7	80.1
ReasonBERT_B 2021.09		90.3	77.5	79.9	68.7	83.7	80.5	80.1
BERT 2021.09		88.8	73.6	78.7	67.5	82	76.2	77.8
Splinter* 2021.09		82.8	64.8	65.5	57.3	67.3	70.3	68
SpanBERT 2021.09		81.1	67	63.2	56.4	70	67.6	67.5
Splinter 2021.09		79.8	67.3	63.8	54.6	68.9	68.4	67.1
ReasonBERT_R 2021.09		79.7	70.1	65	54.7	72.8	69.7	68.7
ROBERTa 2021.09		77.9	62.2	60.3	55	67.5	63.4	64.4
SSPT 2021.09		77.6	60.1	58.7	52.8	65.9	63.3	63.1
ReasonBERT_B 2021.09		76.9	67.4	63.6	52.2	70.6	67.8	66.4
Splinter* 2021.09		72.7	44.7	46.3	43.5	47.2	54.7	51.5
ReasonBERT_R 2021.09		66.7	62.1	49.8	35.7	62.3	57.2	55.6
BERT 2021.09		64.1	41.6	50.1	43	53.1	46.5	49.7
SpanBERT 2021.09		61.2	48.8	38.8	31	50	44	45.7
ReasonBERT_B 2021.09		58.5	56.2	46.7	27.8	60.8	45.2	49.2
Splinter 2021.09		55	45.7	41.1	33.9	48.8	46.9	45.2
Splinter* 2021.09		54.6	18.9	27.4	20.8	26.3	24	28.7
ROBERTa 2021.09		48.8	36	36.4	22.8	41.3	35.2	36.7
SSPT 2021.09		41.5	30.3	35	14	42.8	23.7	31.2
ReasonBERT_R 2021.09		41.3	45.5	33.6	16.2	45.8	34.1	36.1
ReasonBERT_B 2021.09		33.2	37.2	33.1	11.8	46.1	22.4	30.6
BERT 2021.09		21.5	23.9	31.7	11.3	32.6	14	22.5
Splinter 2021.09		16.7	23.9	25.1	11.6	23.6	15.1	19.3
SpanBERT 2021.09		15.7	27.4	24.3	8.1	24.1	16.3	19.3
SSPT 2021.09		10.8	21.2	23.7	6.5	25.8	9.1	16.2
ROBERTa 2021.09		10.3	21	22.5	6.7	23.4	11.2	15.9
BERT 2021.09		9.9	15.4	20.5	6.5	16.8	9.6	13.1