Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LLM Prefill throughput on LLM Prompt Length 256 (pp256)

5,063Prefill Throughput (tok/s)

uzu

343.481,568.742,7944,019.26Jul 1, 2026
Updated 24d ago

Evaluation Results

MethodLinks
2026.07
5,063
2026.07
4,987
2026.07
4,914
2026.07
4,887
2026.07
4,496
2026.07
4,496
2026.07
4,496
2026.07
4,434
2026.07
4,434
2026.07
4,434
2026.07
4,263
2026.07
4,255
2026.07
2,714
2026.07
2,698
2026.07
2,673
2026.07
2,620
2026.07
2,604
2026.07
2,577
2026.07
2,577
2026.07
2,577
2026.07
2,545
2026.07
2,517
2026.07
2,517
2026.07
2,517
2026.07
1,281
2026.07
1,193
2026.07
1,167
2026.07
976
2026.07
928
2026.07
923
2026.07
916
2026.07
906
2026.07
906
2026.07
906
2026.07
901
2026.07
897
2026.07
895
2026.07
888
2026.07
888
2026.07
888
2026.07
809
2026.07
809
2026.07
704
2026.07
704
2026.07
576
2026.07
571
2026.07
550
2026.07
525