Our new X account is live! Follow @wizwand_team for updates

Natural Language Generation on E2E NLG Challenge

70.6BLEU

Dual LoRA (r = 4)

Updated 4d ago

Evaluation Results

Method
Dual LoRA (r = 4) 2025.12	70.6	8.86	46.9	72.4	2.56
Dual LoRA (r = 4) 2025.12	70.6	8.86	47.1	72.5	2.54
GPT-2 M (LoRA) 2021.06	70.4	8.85	46.8	71.8	2.53
GPT-2 L (LoRA) 2021.06	70.4	8.89	46.8	72	2.47
GPT-2 L (PreLayer) 2021.06	70.3	8.85	46.2	71.7	2.47
Prefix 2025.12	70.3	8.85	46.2	71.7	2.47
LoRA (r = 4) 2025.12	70.3	8.85	46.8	71.9	2.52
LoRA+ (r = 8) 2025.12	70.2	8.81	46.6	71.6	2.53
LoRA (r = 8) 2025.12	70	8.8	46.8	71.7	2.54
LoRA+ (r = 8) 2025.12	70	8.83	46.8	71.9	2.53
LoRA (r = 8) 2025.12	69.9	8.77	46.8	71.7	2.5
DoRA (r = 8) 2025.12	69.8	8.78	46.6	71.6	2.52
HiddenKey 2024.02	69.76	8.765	46.8	71.78	2.511
GPT-2 M (PreLayer) 2021.06	69.7	8.81	46.1	71.4	2.49
Prefix 2025.12	69.7	8.81	46.1	71.4	2.49
DoRA (r = 8) 2025.12	69.5	8.75	46.4	71.4	2.52
HiddenKey¯ 2024.02	69.35	8.726	46.6	71.61	2.51
HiddenCut 2024.02	69.22	8.7	46.66	71.39	2.491
GPT-2 L (Adapter^H) 2021.06	69.1	8.68	46.3	71.4	2.49
Adapter-L 2025.12	69.1	8.68	46.3	71.4	2.49
HiddenKey 2024.02	69.02	8.725	45.84	71.17	2.456
GPT-2 M (Adapter^L) [Prior] 2021.06	68.9	8.71	46.1	71.3	2.47
GPT-2 L (Adapter^L) 2021.06	68.9	8.7	46.1	71.3	2.45
Adapter-L 2025.12	68.9	8.71	46.1	71.3	2.47
LoRA (r = 4) 2025.12	68.9	8.69	46.4	71.4	2.52
DropKey 2024.02	68.78	8.651	46.53	71.4	2.486
GPT-2 L (FT) 2021.06	68.5	8.78	46	69.9	2.45
Baseline 2024.02	68.5	8.615	46.43	71.08	2.49
FFT 2025.12	68.5	8.78	46	69.9	2.45
LoRA 2024.02	68.24	8.76	46.23	69.92	2.42
GPT-2 M (FT) 2021.06	68.2	8.62	46.2	71	2.47
Full Finetuning* 2024.02	68.2	8.62	46.2	71	2.47
FFT 2025.12	68.2	8.62	46.2	71	2.47
GPT-2 M (FT_Top2) 2021.06	68.1	8.59	46	70.8	2.41
4-bit AdamW 2023.09	67.8	-	-	-	-
32-bit AdamW 2023.09	67.7	-	-	-	-
4-bit Factor 2023.09	67.6	-	-	-	-
8-bit AdamW† 2023.09	67.5	-	-	-	-
LoRA 2024.02	67.43	8.65	46.01	69.64	2.42
GPT-2 M (Adapter^L) [Re-run] 2021.06	67.3	8.5	46	70.7	2.44
32-bit Adafactor 2023.09	67.2	-	-	-	-
32-bit Adafactor+ 2023.09	67.2	-	-	-	-
32-bit SM3 2023.09	66.9	-	-	-	-
Baseline 2024.02	66.71	8.463	44.82	70.1	2.371
GPT-2 M (Adapter^H) 2021.06	66.3	8.41	45	69.8	2.4
FT 2024.02	65.95	8.52	45.95	69.13	2.35
FT top2 2024.02	65.94	8.53	44.28	68.83	2.23
Adapter 2024.02	65.94	8.46	45.78	68.65	2.34
RED 2024.02	65.77	8.42	46.12	69.03	2.36
FT 2024.02	65.56	8.5	45.4	68.38	2.27
Adapter-FFN 2024.02	65.53	8.41	45.65	68.46	2.33
Prefix Tuning 2024.02	65.5	8.45	43.97	67.32	2.23
IA3 2024.02	65.08	8.5	42.72	66.8	2.15
RED 2024.02	64.86	8.36	44.99	67.62	2.28
Adapter-FFN 2024.02	64.41	8.3	44.74	67.53	2.29
Adapter 2024.02	64.31	8.29	44.91	67.72	2.28
Prefix Tuning 2024.02	63.92	8.26	41.81	66.86	2.03
IA3 2024.02	63.63	7.99	40.49	66.36	1.89