Visual-Language Model Inference on VILA A100
155.3Throughput (tokens/sec)
VILA-7B-AWQ
Updated 2mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2023.06 | 155.3 | |
2023.06 | 102.1 | |
2023.06 | 81.6 | |
2023.06 | 48.5 |
VILA-7B-AWQ
| Method | Links | |
|---|---|---|
2023.06 | 155.3 | |
2023.06 | 102.1 | |
2023.06 | 81.6 | |
2023.06 | 48.5 |