| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Latency Prediction | NNLQ in-domain v1 (test) | MAPE (Average)1.11 | 33 | |
| Latency Prediction | NNLQ Out-of-domain Average | MAPE (Average)8.39 | 8 | |
| Latency Prediction | NNLQ Out-of-domain VGG | MAPE (avg)7.6 | 8 | |
| Latency Prediction | NNLQ Out-of-domain SqueezeNet | MAPE (avg)7.08 | 8 | |
| Latency Prediction | NNLQ Out-of-domain ResNet | MAPE (avg)6.8 | 8 | |
| Latency Prediction | NNLQ Out-of-domain NasBench201 | MAPE (avg)7.93 | 8 | |
| Latency Prediction | NNLQ Out-of-domain MobileNetV3 | MAPE (%)9.06 | 8 | |
| Latency Prediction | NNLQ Out-of-domain MobileNetV2 | MAPE (avg)4.17 | 8 | |
| Latency Prediction | NNLQ Out-of-domain MnasNet | MAPE (avg)2.71 | 8 | |
| Latency Prediction | NNLQ Out-of-domain GoogleNet | MAPE (avg)6.61 | 8 | |
| Latency Prediction | NNLQ Out-of-domain EfficientNet | MAPE (Avg)5.13 | 8 | |
| Latency Prediction | NNLQ Out-of-domain AlexNet | MAPE (avg)7.2 | 8 | |
| Latency Prediction | NNLQ 1.0 (in-domain) | MAPE (avg)- | 0 |