Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Inference Latency on LLaMA 2 70B

1,450Latency (ms)

ROSE

1,436.361,528.431,620.51,712.57Mar 6, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2026.03
1,4501.24
2026.03
1,4581.23
2026.03
1,791-