Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Type Inference on DeepTyper TypeScript (test)
Loading...
54.01
Acc@1
DeepTyper BiLSTM
25.5244
32.9197
40.315
47.7103
Jul 9, 2020
Acc@1
Acc@5
Updated 4d ago
Evaluation Results
Method
Method
Links
Acc@1
Acc@5
DeepTyper BiLSTM
Pre-training Objective...
2020.07
54.01
85.55
DeepTyper BiLSTM
Pre-training Objective...
2020.07
51.73
82.71
DeepTyper BiLSTM
Pre-training Objective...
2020.07
50.24
82.85
Transformer
Pre-training Objective...
2020.07
47.16
81.44
Transformer
Pre-training Objective...
2020.07
46.86
81.85
Transformer
Pre-training Objective...
2020.07
45.66
80.08
TypeScript CheckJS
Type=Static Analysis
2020.07
45.11
-
Transformer
Pre-training Objective...
2020.07
40.85
75.76
GPT-3 Codex
Prompting Setup=few-sh...
2020.07
30.55
-
DeepTyper
Input Constraints=vari...
2020.07
28.94
70.07
GPT-3 Codex
Prompting Setup=zero-s...
2020.07
26.62
-
Feedback
Search any
task
Search any
task