Inference Efficiency on 1024-token sequences (inference summary)
499.49Throughput (Samples/s)
Opir-edge
Updated 5d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.05 | 499.49 | 9.25 | 9.52 | |
2026.05 | 306.81 | 15.6 | 15.69 | |
2026.05 | 123.67 | 13.3 | 14.03 | |
2026.05 | 81.48 | 71.77 | 73.46 | |
2026.05 | 65.45 | 91.3 | 91.8 | |
| 62.19 | 97.63 | 98.31 | ||
2026.05 | 50.51 | 25.65 | 26.09 | |
2026.05 | 42.98 | 28.99 | 30.09 | |
2026.05 | 34.49 | 34.04 | 34.58 | |
2026.05 | 28.79 | 243 | 243.86 | |
2026.05 | 23.51 | 308.59 | 309.86 |