Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Prefill Throughput on Context Length 32K

9,576.2Prefill Throughput (tok/s)

Dense

5,664.9686,680.3847,695.88,711.216Jun 3, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2026.06
9,576.2
2026.06
9,531.5
2026.06
8,555.9
2026.06
8,052.3
2026.06
8,002.2
2026.06
7,985.5
2026.06
6,097.4
2026.06
5,839.7
2026.06
5,833.2
2026.06
5,815.4