Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Summarization on XLSum Japanese (test)
Loading...
11.6
ROUGE-2
Spec.
10.768
10.984
11.2
11.416
Jan 19, 2024
ROUGE-2
ROUGE-L
Tokens/sec
Speed Up (x)
Updated 4d ago
Evaluation Results
Method
Method
Links
ROUGE-2
ROUGE-L
Tokens/sec
Speed Up (x)
Spec.
shots=0, draft_model=L...
2024.01
11.6
26.5
28.5
0.97
MuMo
shots=0
2024.01
11.6
26.3
59.2
2.02
Shortlisting
shots=0, target_langua...
2024.01
11.4
26.3
30.3
1.03
Vanilla Decoding
shots=0
2024.01
11.3
26.6
29.3
1
Spec. (w/o Rejection)
shots=0, draft_model=L...
2024.01
10.8
24.2
35.4
1.21
Feedback
Search any
task
Search any
task