Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Natural Language Generation on SQuAD 17.5K
Loading...
22.2
BLEU
T5-L
20.848
21.199
21.55
21.901
May 3, 2023
BLEU
ROUGE
BScore
PPL
Updated 3mo ago
Evaluation Results
Method
Method
Links
BLEU
ROUGE
BScore
PPL
T5-L
FLOPS=26.1, Latency=53...
2023.05
22.2
42.3
77.9
1.3
BART-L
FLOPS=13.3, Latency=25...
2023.05
21.5
41.9
77.8
1.4
T5-KD
FLOPS=1.8, Latency=143...
2023.05
20.9
40.6
77
1.5
BART-KD
FLOPS=3.4, Latency=67,...
2023.05
20.9
40.9
77.3
1.7
Feedback
Search any
task
Search any
task
