Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Next Token Value Prediction on internal dataset
Loading...
44.7
MRR (Attribute access)
TravTrans
25.668
30.609
35.55
40.491
Mar 30, 2020
MRR (Attribute access)
MRR (Numeric constant)
MRR (Name)
MRR (Function Parameter Name)
MRR (All Leaf Nodes)
Updated 1mo ago
Evaluation Results
Method
Method
Links
MRR (Attribute access)
MRR (Numeric constant)
MRR (Name)
MRR (Function Parameter Name)
MRR (All Leaf Nodes)
TravTrans
2020.03
44.7
61.5
50.7
53.3
43.9
PathTrans
2020.03
41.5
56.1
48
52.1
40.8
Deep3
2020.03
38.5
46.5
41
50.6
31.6
Code2Seq
2020.03
26.4
45.4
31.2
39.3
31
Feedback
Search any
task
Search any
task