Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LIVECODE

Benchmarks

Task NameDataset NameSOTA ResultTrend
CodeLiveCode
Accuracy83.6
30
CodingLiveCode
LiveCode Score41.2
22
Code GenerationLiveCode
Pass@142.8
15
Code GenerationLIVECODE (held-out)
DBS25.7
9
Code GenerationLiveCode (test)
Accuracy67.8
8
Showing 5 of 5 rows