Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Prefill Latency on Llama-3-8B 50 Mbps
Loading...
1.547
Prefill Latency (s)
ASTRA
-1.88908
21.30446
44.498
67.69154
May 25, 2025
Prefill Latency (s)
Updated 6d ago
Evaluation Results
Method
Method
Links
Prefill Latency (s)
ASTRA
G=1
2025.05
1.547
ASTRA
G=16
2025.05
1.595
ASTRA
G=32
2025.05
1.661
BP
Strategy=Block Paralle...
2025.05
2.085
BP
Strategy=Block Paralle...
2025.05
2.773
Llama-3-8B (Single-device)
Device=Single-device
2025.05
4.578
SP
Strategy=Sequence Para...
2025.05
6.888
TP
Strategy=Tensor Parall...
2025.05
87.449
Feedback
Search any
task
Search any
task
