Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Navigation Instruction Generation on Unseen routes 700 instances (test)
Loading...
54.2
Instruction Length
reference
53.16
53.43
53.7
53.97
Dec 30, 2020
Instruction Length
BLEU Score
Landmark Accuracy
SDTW Similarity
Success Rate
Instruction Success Rate
Updated 3mo ago
Evaluation Results
Method
Method
Links
Instruction Length
BLEU Score
Landmark Accuracy
SDTW Similarity
Success Rate
Instruction Success Rate
reference
type=human reference
2020.12
54.2
-
2.69
0.727
84.3
80.7
g2t+pretrain
pretraining=true
2020.12
53.2
16.27
2.3
0.407
47.3
62.9
Feedback
Search any
task
Search any
task