Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Prefill Latency on Llama-3-8B 20 Mbps
Loading...
1.549
Prefill Latency (s)
ASTRA
-7.04068
50.93966
108.92
166.90034
May 25, 2025
Prefill Latency (s)
Updated 6d ago
Evaluation Results
Method
Method
Links
Prefill Latency (s)
ASTRA
G=1
2025.05
1.549
ASTRA
G=16
2025.05
1.659
ASTRA
G=32
2025.05
1.796
BP
Strategy=Block Paralle...
2025.05
3.047
Llama-3-8B (Single-device)
Device=Single-device
2025.05
4.578
BP
Strategy=Block Paralle...
2025.05
4.78
SP
Strategy=Sequence Para...
2025.05
14.939
TP
Strategy=Tensor Parall...
2025.05
216.291
Feedback
Search any
task
Search any
task
