Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Return type hint prediction on TypeWriter OSS 25% subset
Loading...
78.8
Precision
TypeWriter
17.648
33.524
49.4
65.276
Apr 12, 2022
Precision
Recall
F1 Score
Updated 4d ago
Evaluation Results
Method
Method
Links
Precision
Recall
F1 Score
TypeWriter
Supervision=Supervised
2022.04
78.8
69.9
74.1
INCODER-6.7B
Inference=Infill, Retu...
2022.04
76.7
76.7
76.7
INCODER-6.7B
Inference=Left-to-righ...
2022.04
64.3
64.3
64.3
INCODER-6.7B
Inference=Left-to-righ...
2022.04
63.2
63.2
63.2
INCODER-6.7B
Inference=Infill, Retu...
2022.04
46.8
46.8
46.8
INCODER-6.7B
Inference=Left-to-righ...
2022.04
24.2
24.2
24.2
INCODER-6.7B
Inference=Left-to-righ...
2022.04
20
20
20
Feedback
Search any
task
Search any
task