Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Long Code Completion on RepoBench >8k
Loading...
51.24
Edit Sim
HiROPE
0.3632
13.5716
26.78
39.9884
Mar 28, 2024
Edit Sim
Updated 4d ago
Evaluation Results
Method
Method
Links
Edit Sim
HiROPE
Backbone=LLaMA-2 7B
2024.03
51.24
HiROPE
Backbone=Vicuna 7B
2024.03
45.93
ReROPE
Backbone=LLaMA-2 7B
2024.03
45.38
ReROPE
Backbone=Vicuna 7B
2024.03
45.23
HiROPE
Backbone=TinyLLaMA 1.1B
2024.03
39.82
HiROPE
Backbone=ShearedLLaMA...
2024.03
39.52
ReROPE
Backbone=TinyLLaMA 1.1B
2024.03
39.38
ReROPE
Backbone=ShearedLLaMA...
2024.03
33.44
origin
Backbone=TinyLLaMA 1.1B
2024.03
7.07
origin
Backbone=LLaMA-2 7B
2024.03
6.59
origin
Backbone=ShearedLLaMA...
2024.03
2.35
origin
Backbone=Vicuna 7B
2024.03
2.32
Feedback
Search any
task
Search any
task
