Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long Code Completion on RepoBench 4k-8k
Loading...
53.3
Edit Similarity
HiROPE
0.4576
14.1763
27.895
41.6137
Mar 28, 2024
Edit Similarity
Updated 1mo ago
Evaluation Results
Method
Method
Links
Edit Similarity
HiROPE
Backbone=LLaMA-2 7B
2024.03
53.3
ReROPE
Backbone=LLaMA-2 7B
2024.03
47.85
ReROPE
Backbone=Vicuna 7B
2024.03
43.65
HiROPE
Backbone=TinyLLaMA 1.1B
2024.03
43.53
HiROPE
Backbone=Vicuna 7B
2024.03
42.3
ReROPE
Backbone=TinyLLaMA 1.1B
2024.03
40.5
HiROPE
Backbone=ShearedLLaMA...
2024.03
39.98
ReROPE
Backbone=ShearedLLaMA...
2024.03
37.37
origin
Backbone=TinyLLaMA 1.1B
2024.03
7.53
origin
Backbone=LLaMA-2 7B
2024.03
6.79
origin
Backbone=ShearedLLaMA...
2024.03
2.94
origin
Backbone=Vicuna 7B
2024.03
2.49
Feedback
Search any
task
Search any
task
