Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Time to First Token (TTFT) on Generalization Models Tulu3, Qwen3, Lego-Link0
Loading...
1,195.6
TTFT (Standard, ms)
LazyAttention
1,192.328
1,214.414
1,236.5
1,258.586
Jun 3, 2026
TTFT (Standard, ms)
TTFT (Lazy-Attn, ms)
Speedup Factor
Updated 1mo ago
Evaluation Results
Method
Method
Links
TTFT (Standard, ms)
TTFT (Lazy-Attn, ms)
Speedup Factor
LazyAttention
Model=Lego-Link0 + Lla...
2026.06
1,195.6
191.3
6.2
LazyAttention
Model=Tulu3-Block-FT 8B
2026.06
1,196.8
191.7
6.2
LazyAttention
Model=Qwen3-8B
2026.06
1,277.4
201.2
6.35
Feedback
Search any
task
Search any
task