LLM Inference on WebLLM Windows 11 RTX PRO 2000 Blackwell 8GB
51.1Decode Throughput (tok/s)
Qwen2.5-0.5B
Updated 13d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 51.1 | 650 | |
2026.02 | 45.7 | 350 | |
2026.02 | 9.1 | 73 | |
2026.02 | 9.1 | 55 |
Qwen2.5-0.5B
| Method | Links | ||
|---|---|---|---|
2026.02 | 51.1 | 650 | |
2026.02 | 45.7 | 350 | |
2026.02 | 9.1 | 73 | |
2026.02 | 9.1 | 55 |