GPU Inference Throughput on A100-SXM4-40GB
5,081Throughput (tok/s)
DF-SSM
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.04 | 5,081 | - | |
2026.04 | 3,996 | - | |
2026.04 | 1,963 | 4.1 | |
2026.04 | 647 | 5.6 | |
2026.04 | 482 | - | |
2026.04 | 299 | 21.4 | |
2026.04 | 116 | - | |
2026.04 | 14 | - |
DF-SSM
| Method | Links | ||
|---|---|---|---|
2026.04 | 5,081 | - | |
2026.04 | 3,996 | - | |
2026.04 | 1,963 | 4.1 | |
2026.04 | 647 | 5.6 | |
2026.04 | 482 | - | |
2026.04 | 299 | 21.4 | |
2026.04 | 116 | - | |
2026.04 | 14 | - |