Quantization Latency Measurement on NVFP4 Operator
0.01Latency (ms)
vllm default
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 0.01 | - | |
2026.05 | 0.01 | 0.97 | |
2026.05 | 0.012 | - | |
2026.05 | 0.012 | 1.23 | |
2026.05 | 0.013 | 1.08 | |
2026.05 | 0.016 | - | |
2026.05 | 0.016 | 1.35 | |
2026.05 | 0.017 | 1.03 | |
2026.05 | 0.021 | 1.26 | |
2026.05 | 0.025 | - | |
2026.05 | 0.026 | 1.03 | |
2026.05 | 0.032 | 1.29 | |
2026.05 | 0.041 | - | |
2026.05 | 0.042 | 1.01 | |
2026.05 | 0.055 | 1.33 | |
2026.05 | 0.072 | - | |
2026.05 | 0.072 | 0.99 | |
2026.05 | 0.099 | 1.36 | |
2026.05 | 0.134 | 1 | |
2026.05 | 0.135 | - | |
2026.05 | 0.185 | 1.38 | |
2026.05 | 0.258 | - | |
2026.05 | 0.26 | 1.01 | |
2026.05 | 0.357 | 1.38 | |
2026.05 | 0.502 | - | |
2026.05 | 0.502 | 1 | |
2026.05 | 0.689 | 1.37 |