Share your thoughts, 1 month free Claude Pro on usSee more

Question Selection on Fairytale QA (test)

97.5Grammatical Correctness

Ma

Updated 1mo ago

Evaluation Results

Method	Links
Ma 2022.09		97.5	100	95.8	94.3	92	92.2	90.5	94.6	87
Ms 2022.09		96.4	98.8	94.4	95.5	92.5	93.4	91.2	94.6	87.5
bi-gram 2022.09		95.3	99.3	94.3	94.3	93.2	93.7	90.2	94.3	85.7
APS 2022.09		95.2	98.5	95.7	97.2	92.2	97.7	94.8	95.9	89.5
tri-gram + APS 2022.09		94.8	97.8	95.2	93.8	91.8	94	91.3	94.1	86.3
GT 2022.09		94.5	96.3	94.2	93.7	88.5	92.8	89.2	92.7	86.7
bi-gram + APS 2022.09		94.5	98.8	96.2	94.2	92.5	94.5	93.2	94.8	88.8
bi-gram + APS + RT 2022.09		94.5	98.8	96	94.2	91.3	93.7	93.2	94.5	88.3
tri-gram 2022.09		94.3	98	92.2	93	90.5	92.7	85.8	92.4	83.8
bi-gram + RT 2022.09		94.3	99.2	95.2	93.8	91	92.7	91.8	94	86
round-trip (RT) 2022.09		92.8	97	94.5	93.7	88.8	93.5	87.8	92.6	86.2
APS + RT 2022.09		92.7	98.3	95.5	97.3	91.5	94.8	92.8	94.7	89.3
tri-gram + RT 2022.09		92.7	97.3	93.2	92.8	89	93.5	88.2	92.4	85.7
tri-gram + APS + RT 2022.09		92.5	98.7	93.8	96.2	91	94.2	92.2	94.1	88.2