Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Large Language Model Inference on Code Assistant
Loading...
104
TPS
DReSD
11.44
35.47
59.5
83.53
Feb 21, 2025
TPS
Updated 1mo ago
Evaluation Results
Method
Method
Links
TPS
DReSD
Backbone=CodeLlama-7B,...
2025.02
104
DReSD
Backbone=CodeLlama-13B...
2025.02
85
DReSD
Backbone=Llama2-Chat-7...
2025.02
78
REST
Backbone=CodeLlama-7B,...
2025.02
72
REST
Backbone=Llama2-Chat-7...
2025.02
55
DReSD
Backbone=Llama2-Chat-1...
2025.02
50
PLD
Backbone=CodeLlama-7B,...
2025.02
42
REST
Backbone=CodeLlama-13B...
2025.02
39
REST
Backbone=Llama2-Chat-1...
2025.02
32
SD
Backbone=CodeLlama-7B,...
2025.02
31
PLD
Backbone=CodeLlama-13B...
2025.02
29
SD
Backbone=Llama2-Chat-7...
2025.02
25
SD
Backbone=CodeLlama-13B...
2025.02
21
PLD
Backbone=Llama2-Chat-7...
2025.02
21
SD
Backbone=Llama2-Chat-1...
2025.02
20
LLM
Backbone=CodeLlama-7B,...
2025.02
19
LLM
Backbone=Llama2-Chat-7...
2025.02
19
PLD
Backbone=Llama2-Chat-1...
2025.02
19
LLM
Backbone=CodeLlama-13B...
2025.02
15
LLM
Backbone=Llama2-Chat-1...
2025.02
15
Feedback
Search any
task
Search any
task
