Our new X account is live! Follow @wizwand_team for updates

Natural Language Inference on XNLI 1.0 (test)

84.2Accuracy

ERNIE-M

Updated 4d ago

Evaluation Results

Method
ERNIE-M 2020.12	84.2	89.5	86.5	86.9	86.1	86	86.8	84.1	83.8	84.1	84.5	82.1	83.5	81.1	79.4	77.9
XLM-R 2020.12	83.6	89.1	85.1	86.6	85.7	85.3	85.9	83.5	83.2	83.1	83.7	81.5	83.7	81.6	78	78.1
VECO 2020.12	83	88.9	82.4	86	84.7	85.3	86.2	85.8	80.1	83	77.2	80.9	82.8	75.3	83.1	83
ERNIE-M 2020.12	82	89.3	85.1	85.7	84.4	83.7	84.5	82	81.2	81.2	81.9	79.2	81	78.6	76.2	75.4
R4F 2020.08	81.4	89.6	84.7	85.2	84.2	83.6	84.6	82.5	80.3	80.5	80.9	79.2	80.6	78.2	72.7	73.9
InfoXLM 2020.08	81.4	89.7	84.5	85.5	84.1	83.4	84.2	81.3	80.9	80.4	80.8	78.9	80.9	77.9	74.8	73.7
INFOXLM 2020.12	81.4	89.7	84.5	85.5	84.1	83.4	84.2	81.3	80.9	80.4	80.8	78.9	80.9	77.9	74.8	73.7
R3F 2020.08	81.2	89.4	84.2	85.1	83.7	83.6	84.6	82.3	80.7	80.6	81.1	79.4	80.1	77.3	72.6	74.2
XLM-R Large 2020.08	80.9	89.1	84.1	85.1	83.9	82.9	84	81.2	79.6	79.8	80.8	78.1	80.2	76.9	73.9	73.8
XLM-R 2020.12	80.9	89.1	84.1	85.1	83.9	82.9	84	81.2	79.6	79.8	80.8	78.1	80.2	76.9	73.9	73.8
ERNIE-M 2020.12	80.6	86.2	82.5	83.8	82.6	82.4	83.4	80.2	80.6	80.5	81.1	79.2	80.5	77.7	75	73.3
VECO 2020.12	79.9	88.2	79.2	83.1	82.9	81.2	84.2	82.8	76.2	80.3	74.3	77	78.4	71.3	80.4	79.1
INFOXLM 2020.12	79.7	86.1	82	82.8	81.8	80.9	82	80.2	79	78.8	80.5	78.3	80.5	77.4	73	71.6
XLM-R 2020.12	79.1	85.4	81.4	82.2	80.3	80.4	81.3	79.7	78.6	77.3	79.7	77.9	80.2	76.1	73.1	73
Unicoder 2020.12	78.5	85.6	81.1	82.3	80.9	79.5	81.4	79.7	76.8	78.2	77.9	77.1	80.5	73.4	73.8	69.6
XLM 2020.12	77.8	85	80.8	81.3	80.3	79.1	80.9	78.3	75.6	77.6	78.5	76	79.5	72.9	72.8	68.5
ERNIE-M 2020.12	77.3	85.5	80.1	81.2	79.2	79.1	80.4	78.1	76.8	76.3	78.3	75.8	77.4	72.9	69.5	68.8
XLM-R Base 2020.08	76.2	85.8	79.7	80.7	78.7	77.5	79.6	78.1	74.2	73.8	76.5	74.6	76.7	72.4	66.5	68.3
XLM-R 2020.12	76.2	85.8	79.7	80.7	78.7	77.5	79.6	78.1	74.2	73.8	76.5	74.6	76.7	72.4	66.5	68.3
INFOXLM 2020.12	76.2	86.4	80.6	80.8	78.9	77.8	78.9	77.6	75.6	74	77	73.7	76.7	72	66.4	67.1
Unicoder 2020.12	75.4	85.1	79	79.4	77.8	77.2	77.2	76.3	72.8	73.5	76.4	73.6	76.2	69.4	69.7	66.7
XLM 2020.12	75.1	85	78.7	78.9	77.8	76.6	77.4	75.3	72.5	73.1	76.1	73.2	76.5	69.6	68.4	67.3
DMoE 2025.06	39.8	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BLOOM 2025.06	39.2	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BLOOM + Continued Pre-training 2025.06	39.2	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Branch-Train-Mix 2025.06	39.1	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
DMoE 2025.06	37.5	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
DMoE 2025.06	37.5	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Branch-Train-Mix 2025.06	37.2	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BLOOM + Continued Pre-training 2025.06	37.1	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BLOOM 2025.06	37.1	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BLOOM + Continued Pre-training 2025.06	37.1	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Branch-Train-Mix 2025.06	36.8	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BLOOM 2025.06	36.2	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
DMoE 2025.06	35.7	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Branch-Train-Mix 2025.06	35.3	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BLOOM + Continued Pre-training 2025.06	34.7	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BLOOM 2025.06	34.4	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-