MiniCPM
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| LLM Decoding Throughput | MiniCPM4.1-8B 32K context length | Throughput (tok/s)1,358.2 | 24 | |
| LLM Decoding Throughput | MiniCPM 8B 64K context length 4.1 | Throughput (tok/s)1,159.1 | 21 | |
| Prefill throughput | MiniCPM 4.1-8B | Prefill Throughput (tok/s)20,388.3 | 20 | |
| LLM Decoding Throughput | MiniCPM 8B 96K context length 4.1 | Decoding Throughput (tok/s)1,076.3 | 19 | |
| LLM Decoding Throughput | MiniCPM 128K context length 4.1-8B | Decoding Throughput (tok/s)1,000.1 | 16 |
Showing 5 of 5 rows