Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LCB

Benchmarks

Task NameDataset NameSOTA ResultTrend
Code GenerationLCB v6
Accuracy57.1
49
Code GenerationLCB v5
Accuracy61.5
45
Code GenerationLCB v6
Pass@150.68
39
Code GenerationLCB
Speedup7.81
33
Code ReasoningLCB v6
Accuracy53.6
26
Code GenerationLCB
Accuracy85.5
26
Code ReasoningLCB
pass@162.46
26
CodeLCB v6
Score87.7
20
Code reasoningLCB v5
Accuracy33.72
16
Code GenerationLCB
Throughput66.41
16
Code GenerationLCB v6 (val)
Accuracy (%)78
13
CodeLCB
Speedup8.37
12
Code GenerationLCB
Pass@130.1
11
Code GenerationLCB v5
pass@149.5
11
Code GenerationLCB 2408-2505
Pass@174.6
11
Code GenerationLCB (test)
Accuracy21.69
10
Code GenerationLCB v5
Score37.63
9
ReasoningLCB
Score59.58
9
Code GenerationLCB-Hard (171)
Accuracy62.6
8
Code-reasoningLCB v6
Pass@17.7
8
Code GenerationLCB-IO
Pass@181.7
8
CodeLCB Pro Med 25Q2
pass@110.5
7
CodeLCB 08/24-02/25 v5
pass@177.5
7
CodingLCB v6
Pass@131.43
6
CodingLCB v5
Pass@158.42
6
Showing 25 of 38 rows