NVIDIA A100 GPU
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Model Efficiency Analysis | NVIDIA A100 GPU | MACs (G)21.5 | 11 | |
| Multi-Head Attention (MHA) | NVIDIA A100 GPU | TFLOPS207.2 | 5 | |
| Grouped-Query Attention (GQA) | NVIDIA A100 GPU | TFLOPS154.7 | 2 |
Showing 3 of 3 rows