Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long Code Completion on RepoBench 0-4k
Loading...
52.82
Edit Similarity
ReROPE
1.704
14.9745
28.245
41.5155
Mar 28, 2024
Edit Similarity
Updated 1mo ago
Evaluation Results
Method
Method
Links
Edit Similarity
ReROPE
Backbone=LLaMA-2 7B
2024.03
52.82
HiROPE
Backbone=LLaMA-2 7B
2024.03
52.2
ReROPE
Backbone=Vicuna 7B
2024.03
42.78
HiROPE
Backbone=TinyLLaMA 1.1B
2024.03
42.48
HiROPE
Backbone=ShearedLLaMA...
2024.03
40.17
ReROPE
Backbone=TinyLLaMA 1.1B
2024.03
37.72
HiROPE
Backbone=Vicuna 7B
2024.03
37.1
ReROPE
Backbone=ShearedLLaMA...
2024.03
34.03
origin
Backbone=LLaMA-2 7B
2024.03
8.29
origin
Backbone=TinyLLaMA 1.1B
2024.03
7.91
origin
Backbone=ShearedLLaMA...
2024.03
4.39
origin
Backbone=Vicuna 7B
2024.03
3.67
Feedback
Search any
task
Search any
task
