Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Prefill Latency on Llama-3-8B 10 Mbps
Loading...
1.563
Prefill Latency (s)
ASTRA
-15.61256
100.32247
216.2575
332.19253
May 25, 2025
Prefill Latency (s)
Updated 6d ago
Evaluation Results
Method
Method
Links
Prefill Latency (s)
ASTRA
G=1
2025.05
1.563
ASTRA
G=16
2025.05
1.661
ASTRA
G=32
2025.05
1.94
Llama-3-8B (Single-device)
Device=Single-device
2025.05
4.578
BP
Strategy=Block Paralle...
2025.05
4.642
BP
Strategy=Block Paralle...
2025.05
8.011
SP
Strategy=Sequence Para...
2025.05
28.256
TP
Strategy=Tensor Parall...
2025.05
430.952
Feedback
Search any
task
Search any
task
