Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Navigation Instruction Generation on Unseen Routes 200 instances (test)
Loading...
50.3
Length (Len.)
g2t+pretrain
50.012
51.956
53.9
55.844
Dec 30, 2020
Length (Len.)
BLEU
Landmark Score (Landm.)
SDTW
Success Rate (SR)
SNT Score
Updated 3mo ago
Evaluation Results
Method
Method
Links
Length (Len.)
BLEU
Landmark Score (Landm.)
SDTW
Success Rate (SR)
SNT Score
g2t+pretrain
pretraining=true
2020.12
50.3
15.64
2.33
0.387
42.9
53
graph2text
pretraining=false
2020.12
50.5
14.07
1.74
0.344
40
53.4
seq2seq
architecture=Transformer
2020.12
51.8
11.12
1.58
0.074
10
13.7
rule based
type=heuristic system
2020.12
52.3
0.67
10.96
0.472
52.5
51.2
reference
type=human reference
2020.12
57.5
-
2.68
0.725
82.4
79.1
Feedback
Search any
task
Search any
task