CPU Inference Performance Evaluation on Phi-mini-MoE-Instruct
4.1Memory Usage (GB)
Llama.cpp (CPU)
Updated 5d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.04 | 4.1 | 15 | |
2026.04 | 4.1 | 13.3 | |
2026.04 | 14.3 | 40.1 |
Llama.cpp (CPU)
| Method | Links | ||
|---|---|---|---|
2026.04 | 4.1 | 15 | |
2026.04 | 4.1 | 13.3 | |
2026.04 | 14.3 | 40.1 |