Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Inference Latency on OPT-30B

15.7Latency (ms)

LUT-GEMM

14.70821.40428.134.796Jun 4, 2025
Updated 4d ago

Evaluation Results

MethodLinks
2025.06
15.7
2025.06
16.7
2025.06
17.8
2025.06
18.5
2025.06
40.5