Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Navigation Instruction Generation on Partially seen routes 700 instances (test)
Loading...
53.5
Length (Len.)
reference
52.98
53.115
53.25
53.385
Dec 30, 2020
Length (Len.)
BLEU
Landmark Accuracy (Landm.)
SDTW
Success Rate (SR)
SNT
Updated 3mo ago
Evaluation Results
Method
Method
Links
Length (Len.)
BLEU
Landmark Accuracy (Landm.)
SDTW
Success Rate (SR)
SNT
reference
Type=Human Reference
2020.12
53.5
-
2.72
0.726
86.1
83
g2t+pretrain
Pre-training=true
2020.12
53
17.39
2.41
0.475
55.1
66.4
Feedback
Search any
task
Search any
task