Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Task-oriented dialogue on DSTC9 shared task Human Evaluation (test)
Loading...
74.8
Avg Success Rate
Winner
69.392
70.796
72.2
73.604
Feb 9, 2021
Avg Success Rate
Success Rate (w/ DB)
Success Rate (w/o DB)
NLU Score
Response Appropriateness
Dialogue Turns
Updated 4d ago
Evaluation Results
Method
Method
Links
Avg Success Rate
Success Rate (w/ DB)
Success Rate (w/o DB)
NLU Score
Response Appropriateness
Dialogue Turns
Winner
2021.02
74.8
70.2
79.4
4.54
4.47
18.5
AuGPT
variant=Our submission...
2021.02
72.3
62
82.6
4.53
4.41
17.1
Baseline
2021.02
69.6
56.8
82.4
4.34
4.18
18.5
Feedback
Search any
task
Search any
task