Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Summarization on XLSum Korean (test)
Loading...
20.7
ROUGE-2
Vanilla Decoding
18.62
19.16
19.7
20.24
Jan 19, 2024
ROUGE-2
ROUGE-L
Tokens/sec
Speed Up (x)
Updated 4d ago
Evaluation Results
Method
Method
Links
ROUGE-2
ROUGE-L
Tokens/sec
Speed Up (x)
Vanilla Decoding
shots=0
2024.01
20.7
36.1
28.9
1
Shortlisting
shots=0, target_langua...
2024.01
20.5
36.3
30.6
1.06
Spec.
shots=0, draft_model=L...
2024.01
20.3
35.2
27.5
0.95
MuMo
shots=0
2024.01
20.3
35.9
55.3
1.92
Spec. (w/o Rejection)
shots=0, draft_model=L...
2024.01
18.7
33.5
35.2
1.21
Feedback
Search any
task
Search any
task