CPU Inference Performance Evaluation on DeepSeek Lite V2
8.8Memory Usage (GB)
Llama.cpp (CPU)
Updated 3mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.04 | 8.8 | 17.1 | |
2026.04 | 8.9 | 14.2 | |
2026.04 | 29.3 | 50 |
Llama.cpp (CPU)
| Method | Links | ||
|---|---|---|---|
2026.04 | 8.8 | 17.1 | |
2026.04 | 8.9 | 14.2 | |
2026.04 | 29.3 | 50 |