Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Visual-Language Model Inference on VILA Jetson Orin
Loading...
35.6
Throughput (tokens/sec)
VILA-7B-AWQ
4.92
12.885
20.85
28.815
Jun 1, 2023
Throughput (tokens/sec)
Updated 2mo ago
Evaluation Results
Method
Method
Links
Throughput (tokens/sec)
VILA-7B-AWQ
Precision=W4A16
2023.06
35.6
VILA-13B-AWQ
Precision=W4A16
2023.06
17.5
VILA-7B
Precision=FP16
2023.06
11.5
VILA-13B
Precision=FP16
2023.06
6.1
Feedback
Search any
task
Search any
task