Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LLM Prefill throughput on LLM Prompt Length 1024

4,748Prefill Throughput (tok/s)

MLX

419.521,543.262,6673,790.74Jul 1, 2026
Updated 24d ago

Evaluation Results

MethodLinks
2026.07
4,748
2026.07
4,742
2026.07
4,638
2026.07
4,605
2026.07
4,399
2026.07
4,399
2026.07
4,354
2026.07
4,354
2026.07
2,851
2026.07
2,828
2026.07
2,671
2026.07
2,643
2026.07
2,577
2026.07
2,577
2026.07
2,531
2026.07
2,531
2026.07
1,268
2026.07
1,198
2026.07
1,179
2026.07
977
2026.07
942
2026.07
896
2026.07
894
2026.07
888
2026.07
888
2026.07
887
2026.07
874
2026.07
874
2026.07
810
2026.07
810
2026.07
726
2026.07
681
2026.07
681
2026.07
664
2026.07
652
2026.07
586