Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Prefill Latency on Llama-3-8B 200 Mbps
Loading...
1.541
Prefill Latency (s)
ASTRA
0.68164
6.48232
12.283
18.08368
May 25, 2025
Prefill Latency (s)
Updated 6d ago
Evaluation Results
Method
Method
Links
Prefill Latency (s)
ASTRA
G=1
2025.05
1.541
ASTRA
G=16
2025.05
1.559
BP
Strategy=Block Paralle...
2025.05
1.586
ASTRA
G=32
2025.05
1.603
BP
Strategy=Block Paralle...
2025.05
1.762
SP
Strategy=Sequence Para...
2025.05
2.857
Llama-3-8B (Single-device)
Device=Single-device
2025.05
4.578
TP
Strategy=Tensor Parall...
2025.05
23.025
Feedback
Search any
task
Search any
task
