TpuGraphs
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Graph Regression | TpuGraphs (test) | OPA0.892 | 4 | |
| Graph Regression | TpuGraphs (train) | OPA0.8743 | 4 | |
| Layout configuration ranking | TpuGraphs mean across layout (val) | Kendall's Tau0.674 | 3 | |
| Layout configuration ranking | TpuGraphs layout:nlp:default (val) | Kendall's τ0.5628 | 3 | |
| Layout configuration ranking | TpuGraphs layout:nlp:random (val) | Kendall's Tau0.9713 | 3 | |
| Layout configuration ranking | TpuGraphs layout:xla:default (val) | Kendall's Tau0.5887 | 3 | |
| Layout configuration ranking | TpuGraphs layout:xla:random (val) | Kendall's Tau0.684 | 3 | |
| Runtime Prediction | TpuGraphs-Layout XLA-Random | Ordered Pair Accuracy87.6 | 3 | |
| Runtime Prediction | TpuGraphs Layout XLA-Default | Ordered Pair Accuracy79.6 | 3 | |
| Runtime Prediction | TpuGraphs Layout NLP-Random | Ordered Pair Accuracy94.1 | 3 | |
| Runtime Prediction | TpuGraphs Layout NLP-Default | Ordered Pair Accuracy82.1 | 3 | |
| Runtime prediction | TpuGraphs Layout+Tile | Averaged Accuracy61.9 | 3 | |
| Tile configuration ranking | TpuGraphs tile:xla (val) | Tile Ranking Metric96.94 | 2 |
Showing 13 of 13 rows