Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code generation on LiveCodeBench start date 2023-09-01 May 2023 to February 2024
Loading...
23.2
Pass@1
CodeQwen1.5-7B-Chat
12.176
15.038
17.9
20.762
Oct 31, 2024
Pass@1
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass@1
CodeQwen1.5-7B-Chat
Parameters=7B, Variant...
2024.10
23.2
SelfCodeAlign-CQ-7B
Parameters=7B, Variant=CQ
2024.10
22.4
CodeQwen1.5-7B-Base
Parameters=7B, Variant...
2024.10
19.3
CodeQwen1.5-7B-OctoPack
Parameters=7B, Trainin...
2024.10
19.3
DeepSeek-Coder-6.7B-Instruct
Parameters=6.7B, Varia...
2024.10
19.2
Llama-3-8B-Instruct
Parameters=8B, Variant...
2024.10
18.3
CodeGemma-7B-IT
Parameters=7B, Variant=IT
2024.10
15.2
StarCoder2-15B
Parameters=15B
2024.10
14.5
OctoCoder-16B
Parameters=16B
2024.10
12.6
Feedback
Search any
task
Search any
task