Share your thoughts, 1 month free Claude Pro on usSee more

Natural Language Inference on ANLI (Accuracy and Calibration)

74.02Accuracy

Zero-shot-EI

Updated 5d ago

Evaluation Results

Method
Zero-shot-EI 2026.02	74.02	-	-	-	-	-
Zero-shot 2026.02	71	-	-	-	-	-
RevThink 2026.02	65.1	-	-	-	-	-
Answer Aug 2026.02	64.83	-	-	-	-	-
Question Aug 2026.02	64.45	-	-	-	-	-
ExGRPO 2026.02	64.42	-	-	-	-	-
On-Policy Distillation 2026.02	64.18	-	-	-	-	-
ExGRPO 2026.02	64	-	-	-	-	-
Rephrase Question 2026.02	63.95	-	-	-	-	-
Divide-or-Conquer 2026.02	63.89	-	-	-	-	-
Distill Step-by-Step 2026.02	63.58	-	-	-	-	-
SKD 2026.02	62.73	-	-	-	-	-
Zero-shot 2026.02	61.67	-	-	-	-	-
ExGRPO 2026.02	56.34	-	-	-	-	-
ExGRPO 2026.02	55.75	-	-	-	-	-
MUPPET 2022.12	52.59	-	-	-	-	-
On-Policy Distillation 2026.02	52.18	-	-	-	-	-
ColD-Fusion 2022.12	52	-	-	-	-	-
Finetune 2022.12	51.51	-	-	-	-	-
Multitask 2022.12	51.48	-	-	-	-	-
MI-based distillation 2024.03	51.2	-	-	-	-	-
DSS 2024.03	49.58	-	-	-	-	-
ZipCal 2026.03	47.58	-	-	-	-	-4.32
Divide-or-Conquer 2026.02	47.45	-	-	-	-	-
RevThink 2026.02	47.36	-	-	-	-	-
SITE (M = 50) 2025.07	47.31	-	-	-	-	-
(IA)3 2025.07	47.03	-	-	-	-	-
SITE (M = 1) 2025.07	46.35	-	-	-	-	-
LoRA 2025.07	45.82	-	-	-	-	-
SKD 2026.02	45.42	-	-	-	-	-
Distill Step-by-Step 2026.02	44.23	-	-	-	-	-
10-shot ICL 2025.07	43.96	-	-	-	-	-
Finetuning 2024.03	43.58	-	-	-	-	-
Single-task 2024.03	43.5	-	-	-	-	-
Rephrase Question 2026.02	43.07	-	-	-	-	-
Answer Aug 2026.02	42.72	-	-	-	-	-
Question Aug 2026.02	41.22	-	-	-	-	-
QLoRA 2025.09	39.06	-	-	-	-	-
CoA-LoRA 2025.09	38.28	-	-	-	-	-
Shared-LoRA 2025.09	38.28	-	-	-	-	-
CoA-LoRA 2025.09	38.28	-	-	-	-	-
Zero-shot 2026.02	37.92	-	-	-	-	-
ZipCal 2026.03	37.61	-	-	-	-	-6.89
MTV 2025.07	34.7	-	-	-	-	-
LQ-LoRA 2025.09	34.38	-	-	-	-	-
Prompt Tuning 2025.07	33.22	-	-	-	-	-
TV 2025.07	33.17	-	-	-	-	-
IV 2025.07	31.52	-	-	-	-	-
Ensemble 2022.10	31.41	85.49	54.09	16.49	86.4	-
I-Vanilla 2022.10	31.41	40.92	38.3	65.43	43.82	-
Vanilla 2022.10	31.31	75.48	44.17	26.87	90.3	-
TS 2022.10	31.31	85.58	54.27	16.22	86.41	-
E-MLP 2022.10	31.31	81.65	50.74	18.39	81.66	-
E-T5 2022.10	31.31	41.67	38.68	65.84	45.11	-
Shared-LoRA 2025.09	31.25	-	-	-	-	-
LQ-LoRA 2025.09	31.25	-	-	-	-	-
I-Iter 2022.10	30.69	37.02	28.37	68.84	39.62	-
I-Simul 2022.10	30.66	38.65	46.06	68.4	41.76	-
LS 2022.10	30.5	77.71	47.21	23.77	78.36	-
EDA 2022.10	30.34	87.45	57.11	13.86	88.03	-
I2CL 2025.07	28.01	-	-	-	-	-
QLoRA 2025.09	27.34	-	-	-	-	-
0-shot ICL 2025.07	0	-	-	-	-	-
FV 2025.07	0	-	-	-	-	-
LIVE 2025.07	0	-	-	-	-	-
DSS 2024.03	-	42.72	11.12	-	-	-
MI-based distillation 2024.03	-	35.9	6.94	-	-	-