Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Repository-level code-completion on RepoEval (test)
Loading...
49.9
Exact Match
RLCoder
27.54
33.345
39.15
44.955
Feb 4, 2026
Exact Match
Updated 1mo ago
Evaluation Results
Method
Method
Links
Exact Match
RLCoder
Params=1.1B, Latency=8...
2026.02
49.9
GraphCoder
Params=16B, Latency=17...
2026.02
48.7
DRACO
Params=7.1B, Latency=1...
2026.02
46.4
HEF (e2e + p-tuning)
Params=1.8B, Latency=0...
2026.02
43.9
HEF (end-to-end)
Params=1.8B, Latency=0...
2026.02
42.7
HEF (separate)
Params=1.8B, Latency=0...
2026.02
34.1
RepoFusion
Params=0.22B, Latency=...
2026.02
33.2
Qwen-2.5-Coder-1.3B
Params=1.5B, Latency=0...
2026.02
28.4
Feedback
Search any
task
Search any
task