Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Story Generation on ROC (test)
Loading...
37.5
Fluency Win Rate
HINT
32.82
34.035
35.25
36.465
May 19, 2021
Fluency Win Rate
Fluency Lose Rate
Fluency Tie Rate
Fluency Kappa (κ)
Coherence Win Rate
Coherence Lose Rate
Coherence Tie Rate
Coherence Kappa (κ)
Updated 4d ago
Evaluation Results
Method
Method
Links
Fluency Win Rate
Fluency Lose Rate
Fluency Tie Rate
Fluency Kappa (κ)
Coherence Win Rate
Coherence Lose Rate
Coherence Tie Rate
Coherence Kappa (κ)
HINT
Manual Evaluation Prot...
2021.05
37.5
24
38.5
0.58
54.5
11
34.5
0.59
HINT
Manual Evaluation Prot...
2021.05
37
31
32
0.68
47.5
23
29.5
0.67
HINT
Manual Evaluation Prot...
2021.05
35.5
21
43.5
0.63
47.5
21.5
31
0.62
HINT
Manual Evaluation Prot...
2021.05
35.5
28.5
36
0.6
55.5
24
20.5
0.58
HINT
Manual Evaluation Prot...
2021.05
33
25.5
41.5
0.62
42
28
30
0.63
Feedback
Search any
task
Search any
task
