Snippet Generation on Industry Workload Llama-3.1-8B
8.67Throughput (A100)
BatchLLM
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.11 | 8.67 | 4.24 | |
2024.11 | 6.71 | 3.36 | |
2024.11 | 6.2 | 3.27 | |
2024.11 | 5.48 | 2.84 | |
2024.11 | 5.45 | 2.75 |
BatchLLM
| Method | Links | ||
|---|---|---|---|
2024.11 | 8.67 | 4.24 | |
2024.11 | 6.71 | 3.36 | |
2024.11 | 6.2 | 3.27 | |
2024.11 | 5.48 | 2.84 | |
2024.11 | 5.45 | 2.75 |