Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Software Engineering Tasks on Claude Code
Loading...
40
Successful Tasks Count
Original
28.56
31.53
34.5
37.47
May 5, 2026
Successful Tasks Count
Input Tokens (M)
Output Tokens (K)
Cache Tokens (M)
Total Tokens (M)
Average Tokens per Task (M)
Updated 2mo ago
Evaluation Results
Method
Method
Links
Successful Tasks Count
Input Tokens (M)
Output Tokens (K)
Cache Tokens (M)
Total Tokens (M)
Average Tokens per Task (M)
Original
Condition=Original
2026.05
40
32.9
574
30.1
33.4
0.84
Vanilla
Condition=Vanilla
2026.05
34
19.5
421
17.2
19.9
0.59
Compiled
Condition=Compiled
2026.05
29
18.3
459
15.8
18.7
0.65
Feedback
Search any
task
Search any
task
