Inference Throughput on GPT-J 6B
1,484Inference Throughput (tokens/s)
GPT-J-6B (Proposed Method)
Updated 19d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 1,484 | 113.8 | |
2026.05 | 1,430.3 | 108 | |
2026.05 | 1,426.8 | 106.3 | |
2026.05 | 1,396.4 | 92.7 | |
2026.05 | 1,382 | 68 | |
2026.05 | 1,374 | 67.9 | |
2026.05 | 1,370.2 | - | |
2026.05 | 1,325.7 | 64.8 | |
2026.05 | 1,322.3 | - | |
2026.05 | 1,320.5 | - | |
2026.05 | 1,314.1 | - | |
2026.05 | 1,306.1 | - | |
2026.05 | 1,303.8 | - | |
2026.05 | 1,276.8 | 53.8 | |
2026.05 | 1,260.9 | - | |
2026.05 | 1,223 | - |