Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Prefill Latency on Llama-3-8B 100 Mbps
Loading...
1.545
Prefill Latency (s)
ASTRA
-0.17316
11.42442
23.022
34.61958
May 25, 2025
Prefill Latency (s)
Updated 6d ago
Evaluation Results
Method
Method
Links
Prefill Latency (s)
ASTRA
G=1
2025.05
1.545
ASTRA
G=16
2025.05
1.572
ASTRA
G=32
2025.05
1.63
BP
Strategy=Block Paralle...
2025.05
1.753
BP
Strategy=Block Paralle...
2025.05
2.101
SP
Strategy=Sequence Para...
2025.05
4.215
Llama-3-8B (Single-device)
Device=Single-device
2025.05
4.578
TP
Strategy=Tensor Parall...
2025.05
44.499
Feedback
Search any
task
Search any
task
