Our new X account is live! Follow @wizwand_team for updates

Grammatical Error Correction on BEA shared task 2019 (test)

80.84F0.5 Score

GRECO voting+ESC

Updated 3d ago

Evaluation Results

Method
GRECO voting+ESC 2023.10	80.84	86.66	63.72
GRECO voting+ESC 2023.10	80.5	86.45	63.13
ESC 2023.10	80.1	86.64	61.54
EditScorer 2023.10	80.05	88.05	58.71
Qorib et al. 2023.09	79.9	86.6	60.9
ESC 2023.10	79.9	86.65	60.91
GRECO voting 2023.10	78.85	83.24	65.12
GRECO voting 2023.10	78.58	82.86	65.1
4xRPN ensemble 2023.09	77.6	86.62	54.8
MEMT 2023.10	77.48	82.2	63
GRECO 2023.10	77.24	80.46	66.59
GRECO 2023.10	76.83	80.03	66.22
GECToR Ensemble (DeBERTa + RoBERTa + XLNet) 2022.03	76.05	84.44	54.42
Rothe et al. 2023.09	75.9	-	-
Rothe et al. 2022.03	75.88	-	-
Stahlberg and Kumar 2022.03	74.9	77.7	65.4
Stahlberg and Kumar 2023.09	74.9	77.7	65.4
T5-XL 2023.10	74.72	76.85	67.26
RPN(MPRBASE) 2023.09	74.47	80.8	56.71
DeCoGLM 2024.05	74.4	77.4	64.6
TemplateGEC 2024.05	74.1	76.8	64.8
GECTOR 2020.05	73.7	79.4	57.2
Omelianchuk et al. 2022.03	73.7	79.4	57.2
Omelianchuk et al. (2020) 2023.07	73.7	79.4	57.2
Omelianchuk et al. 2023.09	73.7	79.4	57.2
GECTOR 2020.05	73.6	78.9	58.2
DeGLM-CoGLM 2024.05	73.4	76.4	63.4
GECToR-Large (RoBERTa) 2022.03	73.21	80.7	53.39
GECTOR-Large 2023.10	73.21	80.7	53.39
Kantor et al. (2019) 2020.05	73.2	78.3	58
Kantor et al. (2019) 2021.09	73.2	78.3	58
GEC System Combination (1+2) 2019.06	73.18	78.31	58
Lichtarge et al. 2023.09	73	75.4	64.7
+ BIFI (ours) 2021.09	72.9	79.4	55
Sun et al. (2021) 2022.10	72.9	-	-
SynGEC 2022.10	72.9	75.1	65.5
SynGEC 2024.05	72.9	75.1	65.5
GEC System Combination (1+2+3+4) 2019.06	72.84	78.74	56.04
GECToR-Large (RoBERTa@5K) 2022.03	72.69	80.55	52.27
T5-Large 2023.10	72.66	74.3	66.75
GECTOR 2020.05	72.4	79.2	53.9
GECTOR (Omelianchuk et al., 2020) 2021.09	72.4	79.2	53.9
GECTOR (our base) 2021.09	72.4	79.2	53.9
Omelianchuk et al. 2022.03	72.4	79.2	53.9
Omelianchuk et al. (2020) 2022.10	72.4	79.2	53.9
Omelianchuk et al. (2020) 2023.07	72.4	79.2	53.9
GECTOR XLNet 2023.10	72.4	79.2	53.9
GECToR 2024.05	72.4	79.2	53.9
GOPar 2022.10	72.3	74.6	64.1
Rothe et al. (2021) 2022.10	72.1	-	-
T5 2024.05	72.1	-	-
Our Baseline 2022.10	72	74	64.9
BART 2024.05	72	74	64.9
DeGLM-CoGLM 2024.05	71.69	72.8	67.57
GECTOR 2020.05	71.5	77.2	55.1
GECTOR ROBERTa 2023.10	71.5	77.2	55.1
Multi-Encoder 2024.05	70.6	73.3	61.5
Stahlberg and Kumar 2022.03	70.4	72.1	64.4
Stahlberg and Kumar (2021) 2022.10	70.4	72.1	64.4
PRETLARGE+SSE+R2L+SED 2019.09	70.2	74.7	56.7
Kiyono et al. (2019) 2020.05	70.2	74.7	56.7
Kiyono et al.* 2020.05	70.2	74.7	56.7
Kiyono et al. 2020.05	70.2	74.7	56.7
Kiyono et al. (2019) 2021.09	70.2	74.7	56.7
Kiyono et al. 2022.03	70.2	74.7	56.7
Kiyono et al. (2019) 2023.07	70.2	74.7	56.7
Riken&Tohoku 2023.10	70.2	74.7	56.7
PRETLARGE+SSE+R2L 2019.09	69.8	72.1	61.8
BERT-fuse GED + R2L 2020.05	69.8	72.3	61.4
Kaneko et al. 2020.05	69.8	72.3	61.4
Kaneko et al. 2022.03	69.8	72.3	61.4
GEC System Combination (3+4) 2019.06	69.72	74.99	54.41
VERNet 2023.10	69.67	73.19	58.42
Grundkiewicz et al. (2019) 2019.09	69.5	72.3	60.1
Grundkiewicz et al. 2020.05	69.5	72.3	60.1
Grundkiewicz et al. (2019) 2021.09	69.5	72.3	60.1
Grundkiewicz et al. 2022.03	69.5	72.3	60.1
UEDIN-MS 2019.06	69.47	72.28	60.12
UEDIN-MS 2023.10	69.47	72.28	60.12
LLaMA2 2024.05	69.42	69.46	69.28
AMR-GEC 2023.07	69.1	73.5	55.9
Kakao&Brain 2019.06	69	75.19	51.91
Kakao&Brain 2023.10	69	75.19	51.91
SynGEC 2022.10	68.4	70.9	59.9
AMR-GEC 2023.07	68.4	71.5	58.3
GEC-DePenD 2024.05	67.9	72.9	53.2
GECTOR 2020.05	67.6	71.5	55.7
GPT-2 2023.10	67.38	67.2	68.08
Wan and Wan (2021) 2022.10	67.3	74.5	48.6
Rothe et al. (2021) 2023.07	67.1	-	-
SpanDC 2024.05	66.9	70.4	55.9
SOME 2023.10	66.68	66.4	67.83
Shuyao 2019.06	66.61	70.17	55.39
Lichtarge et al. (2020) 2022.10	66.5	67.6	62.5
LLaMA2 2024.05	66.15	66.16	66.12
BART-based 2020.05	66.1	68.8	57.1
Katsumata and Komachi (2020) 2023.07	66.1	68.8	57.1
REP(SIM)+WDROP 2021.04	65.97	-	-
REP(UNI)+WDROP 2021.04	65.94	-	-
ADV 2021.04	65.9	-	-

Showing 100 of 139 rows