Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Insertion on DS-1000 1.0 (test)
Loading...
55.2
Success Rate (Matplotlib)
WizardCoder
27.224
34.487
41.75
49.013
Jun 14, 2023
Success Rate (Matplotlib)
Success Rate (NumPy)
Success Rate (Pandas)
Success Rate (Python)
Success Rate (SCP Library)
Success Rate (Scikit-learn)
Success Rate (TensorFlow)
Overall Success Rate
Updated 1mo ago
Evaluation Results
Method
Method
Links
Success Rate (Matplotlib)
Success Rate (NumPy)
Success Rate (Pandas)
Success Rate (Python)
Success Rate (SCP Library)
Success Rate (Scikit-learn)
Success Rate (TensorFlow)
Overall Success Rate
WizardCoder
Format=Insertion, temp...
2023.06
55.2
35.1
20.4
30.4
28.9
32.3
37.8
32.8
StarCoder
Format=Insertion, temp...
2023.06
51.7
30.8
10.3
21
20.2
27.4
20
25.4
InCoder-6B
Format=Insertion, temp...
2023.06
28.3
4.6
2.9
4.4
2.8
3.1
7.8
7.5
Feedback
Search any
task
Search any
task