KernelBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| CUDA Kernel Generation | KernelBench Level 3 | Executions Count24 | 31 | |
| CUDA Kernel Generation | KernelBench Level 2 | Execution Count48 | 31 | |
| CUDA Kernel Generation | KernelBench Level 1 | Exec Count46 | 31 | |
| Kernel Optimization | KernelBench 1.0 (test) | Latency (us)0.0063 | 27 | |
| Triton kernel generation | KernelBench LEVEL3 1.0 | Fast1 Score29.8 | 17 | |
| Triton kernel generation | KernelBench LEVEL2 1.0 | Fast1 Score80.9 | 17 | |
| Triton kernel generation | KernelBench LEVEL1 1.0 | Fast139.3 | 17 | |
| GPU Kernel Optimization | KernelBench Level 2 | Validity Rate95 | 5 | |
| GPU Kernel Optimization | KernelBench Level 1 | Validity Rate0.93 | 5 | |
| CUDA Code Validation | KernelBench Level 1 | Success Rate (p=1.0)8 | 5 | |
| GPU Kernel Optimization | KernelBench Level 3 | Kernel Validity Rate67 | 2 |
Showing 11 of 11 rows