Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Latency Evaluation on Azure trace
Loading...
0.28
TTFT P50
Token-budget
0.2744
0.3122
0.35
0.3878
Apr 9, 2026
TTFT P50
TTFT P99
TPOT P50
TPOT P99
Updated 9d ago
Evaluation Results
Method
Method
Links
TTFT P50
TTFT P99
TPOT P50
TPOT P99
Token-budget
Request rate=1,000 req/s
2026.04
0.28
1.71
25
62
Homogeneous
Request rate=1,000 req/s
2026.04
0.42
1.82
28
67
Feedback
Search any
task
Search any
task
