LLM Decode Throughput on Apple M3 base tg128 (test)
223Throughput (tok/s)
BaseRT
Updated 24d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.07 | 223 | 1.24 | 1.22 | |
2026.07 | 182.3 | - | - | |
2026.07 | 180.5 | - | - | |
2026.07 | 125.6 | 1.18 | 1.12 | |
2026.07 | 124.6 | 1.25 | 1.1 | |
2026.07 | 113.6 | - | - | |
2026.07 | 112.6 | - | - | |
2026.07 | 106.3 | - | - | |
2026.07 | 99.8 | - | - | |
2026.07 | 65.1 | 1.13 | 1.04 | |
2026.07 | 62.4 | - | - | |
2026.07 | 59 | 1.25 | - | |
2026.07 | 57.5 | - | - | |
2026.07 | 47.1 | - | - | |
2026.07 | 44.5 | 1.14 | 1.01 | |
2026.07 | 43.9 | - | - | |
2026.07 | 39 | - | - | |
2026.07 | 35.4 | 1.34 | - | |
2026.07 | 26.5 | - | - | |
2026.07 | 24.2 | 1.14 | 1.09 | |
2026.07 | 22.2 | - | - | |
2026.07 | 21.2 | - | - |