NVFP4
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Time to First Token (TTFT) | NVFP4-W4A16 | Time to First Token (ms)182 | 32 | |
| Quantization latency measurement | NVFP4 quantization operator | Latency (ms)0.01 | 27 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Time to First Token (TTFT) | NVFP4-W4A16 | Time to First Token (ms)182 | 32 | |
| Quantization latency measurement | NVFP4 quantization operator | Latency (ms)0.01 | 27 |