Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Next Token Value Prediction on internal dataset
Loading...
44.7
MRR (Attribute access)
TravTrans
25.668
30.609
35.55
40.491
Mar 30, 2020
MRR (Attribute access)
MRR (Numeric constant)
MRR (Name)
MRR (Function Parameter Name)
MRR (All Leaf Nodes)
Updated 4d ago
Evaluation Results
Method
Method
Links
MRR (Attribute access)
MRR (Numeric constant)
MRR (Name)
MRR (Function Parameter Name)
MRR (All Leaf Nodes)
TravTrans
2020.03
44.7
61.5
50.7
53.3
43.9
PathTrans
2020.03
41.5
56.1
48
52.1
40.8
Deep3
2020.03
38.5
46.5
41
50.6
31.6
Code2Seq
2020.03
26.4
45.4
31.2
39.3
31
Feedback
Search any
task
Search any
task