Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Transformer Inference Latency Estimation on LLaMA 3 (8B)

283.157Inference Latency (s)

Bifrost

182.2878863.15491,544.0222,224.8891Jun 16, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2026.06
283.1579.906
2026.06
2,804.887-