Our new X account is live! Follow @wizwand_team for updates

Cross-lingual Language Understanding on XTREME

83.9XNLI Accuracy

FILTER

Updated 4d ago

Evaluation Results

Method
FILTER 2020.10	83.9	76.2	67.7	91.4	68	82.4	57.7	76.2	50.9	68.3	74.9	76	-	-
VECO 2020.10	83	75.1	65.7	91.1	66.3	79.9	54.9	73.1	58.9	75	74.1	75.1	-	-
XLM-Rlarge+NoisyTune 2022.02	82.5	77.8	67.9	90.5	66.1	80.4	54.9	73.3	48.2	66.8	-	76.8	82.9	83
XLM-Rlarge 2022.02	82.3	77.3	67.3	90.3	65.6	80	54.4	72.9	47.6	66.3	-	76.4	82.5	82.7
InfoXLM_large 2023.06	81.4	-	-	-	-	-	55.2	73.6	-	-	-	-	-	-
XLM-P_large 2023.06	81.2	77	68.5	88.9	64.4	79.2	56.4	73.7	55.7	72.7	-	-	-	-
XLM-P_large 2023.06	81.1	76.9	68.1	88.7	63.9	79	53.5	72.4	55	72.1	-	-	-	-
RemBERT 2020.10	80.8	76.5	70.1	87.5	64	79.6	55	73.1	63	77	74.4	75.4	-	-
STiLTs 2020.10	80	74.9	64	87.9	63.3	78.7	53.7	72.4	59.5	76	72.7	73.5	-	-
VECO_large 2023.06	79.9	75.1	65.7	88.7	61.8	77.3	53.2	71.7	49.1	67.6	-	-	-	-
XLM-Rlarge+NoisyTune 2022.02	79.3	73.5	63.2	86.5	61	76.7	53.6	71.9	45.6	65.4	-	73	79.9	76.8
XLM-R 2020.10	79.2	73.8	65.4	86.4	60.8	76.6	53.2	71.6	45	65.1	70.1	71.4	-	-
XLM-R_large 2023.06	79.2	72.6	65.4	86.4	60.8	76.6	53.2	71.6	45	65.1	-	-	-	-
XLM-Rlarge 2022.02	79	72.7	62.3	86.3	60.4	76.2	53	71.4	45	65	-	72.4	79.2	76
XLM-Rbase+NoisyTune 2022.02	78.9	76.8	63.1	88.6	61.8	75.4	50.4	68	48.1	64.1	-	73.7	80	79.8
XLM-Rbase 2022.02	78.5	76.2	62.6	88.2	61.5	75	50.1	67.8	47.6	63.8	-	73.3	79.6	79.4
XLM-E 2021.06	76.6	75.6	63.5	88.3	60.2	76.2	49.8	68.3	45.7	62.4	69.3	-	-	-
INFOXLM 2021.06	76.5	-	-	-	-	-	49.6	68.1	-	-	-	-	-	-
XLM-ALIGN 2021.06	76.2	76	63.7	86.8	59	74.7	49.8	68.1	44.8	62.1	68.9	-	-	-
XLM-ALIGN 2021.06	76.2	76	63.7	86.8	59	74.7	49.8	68.1	44.8	62.1	68.9	-	-	-
MT5 2021.06	75.4	-	55.7	86.4	49	67	45	64.6	41.2	57.2	-	-	-	-
XLM-P_base 2023.06	75.4	74.3	63.8	86.6	60.4	75.3	49.4	67.4	41.6	58.5	-	-	-	-
MT5base 2021.06	75.4	-	56.6	87.4	49	67	45	64.6	42.8	58.1	-	-	-	-
XLM-Rbase+NoisyTune 2022.02	75.2	76	62.1	85.1	57.1	72.3	47.4	65.5	39.2	56	-	70.5	78.2	74.5
XLM-E (w/o TRTD) 2021.06	75.1	74.2	62.7	87.1	58.2	74.3	49.7	67.8	40.6	57.8	67.6	-	-	-
MT5_base 2023.06	75.1	-	55.7	86.4	49	67	45	64.6	41.2	57.2	-	-	-	-
XLM-E (-TRTD)_base 2023.06	75.1	74.2	62.7	87.1	58.2	74.3	49.7	67.8	40.6	57.8	-	-	-	-
XLM-P_base 2023.06	75.1	73.9	63.6	86	61.5	75.8	50.1	68.7	42.8	59.3	-	-	-	-
XLM-R 2021.06	75	75.6	61.8	84.9	56.4	71.9	47.2	65.1	38.3	55.4	66.4	-	-	-
XLM-R_base 2023.06	75	75.6	61.8	84.9	56.4	71.9	47.2	65.1	38.3	55.4	-	-	-	-
XLM-Rbase 2021.06	75	75.6	61.8	84.9	56.4	71.9	47.2	65.1	38.3	55.4	66.4	-	-	-
XLM-Rbase 2022.02	74.8	75.5	61.6	84.8	56.6	71.9	47	65.2	38.4	55.5	-	70	77.6	73.8
XLM 2021.06	69.1	70.1	61.2	80.9	44.3	59.8	32.6	48.5	29.1	43.6	58.6	-	-	-
XLM_base 2023.06	69.1	71.3	61.2	80.9	44.3	59.8	32.6	48.5	29.1	43.6	-	-	-	-
XLM* 2021.06	69.1	70.1	61.2	80.9	44.3	59.8	32.6	48.5	29.1	43.6	58.6	-	-	-
MBERT* 2021.06	65.4	70.3	62.2	81.9	49.4	64.5	44.2	61.4	43.9	59.7	63.1	-	-	-
MBERT 2021.06	65.1	70.3	62.2	81.9	49.4	64.5	44.2	61.4	43.9	59.7	63.1	-	-	-
MBERT_base 2023.06	65.1	70.3	62.2	81.9	49.4	64.5	44.2	61.4	43.9	59.7	-	-	-	-
mBERT 2021.06	-	-	-	-	-	-	-	-	-	-	-	63.1	-	-
XLM-R 2021.06	-	-	-	-	-	-	-	-	-	-	-	66.4	-	-
XLM-ALIGN 2021.06	-	-	-	-	-	-	-	-	-	-	-	68.9	-	-
XLM-E 2021.06	-	-	-	-	-	-	-	-	-	-	-	69.3	-	-
XLM-E (w/o TRTD) 2021.06	-	-	-	-	-	-	-	-	-	-	-	67.6	-	-