Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Long Code Completion on LCC (4k-8k)
Loading...
69.93
Edit Similarity
HiROPE
-0.1348
18.0551
36.245
54.4349
Mar 28, 2024
Edit Similarity
Updated 4d ago
Evaluation Results
Method
Method
Links
Edit Similarity
HiROPE
Backbone=LLaMA-2 7B
2024.03
69.93
ReROPE
Backbone=LLaMA-2 7B
2024.03
67.43
HiROPE
Backbone=Vicuna 7B
2024.03
62.01
ReROPE
Backbone=Vicuna 7B
2024.03
59.73
ReROPE
Backbone=TinyLLaMA 1.1B
2024.03
57.2
HiROPE
Backbone=ShearedLLaMA...
2024.03
51.67
HiROPE
Backbone=TinyLLaMA 1.1B
2024.03
42.83
ReROPE
Backbone=ShearedLLaMA...
2024.03
36.1
origin
Backbone=TinyLLaMA 1.1B
2024.03
5.45
origin
Backbone=LLaMA-2 7B
2024.03
4.36
origin
Backbone=ShearedLLaMA...
2024.03
3.33
origin
Backbone=Vicuna 7B
2024.03
2.56
Feedback
Search any
task
Search any
task
