NLGraph
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Natural Language Graph Reasoning | NLGraph (test) | Accuracy37.6 | 22 | |
| Natural Language Graph Reasoning | NLGraph (val) | Accuracy54.5 | 22 | |
| Graph Reasoning | NLGraph | Success Rate97 | 16 | |
| Connectivity | NLGraph | Accuracy (0-20)100 | 6 | |
| Cycle | NLGraph hard | Accuracy80.2 | 3 | |
| Cycle | NLGraph medium | Accuracy81.5 | 3 | |
| Cycle | NLGraph easy | Accuracy84.7 | 3 | |
| Shortest path | NLGraph hard | Accuracy98 | 3 | |
| Shortest path | NLGraph easy | Accuracy (NLGraph easy)97.7 | 3 | |
| Connectivity | NLGraph hard | Accuracy83.1 | 3 | |
| Connectivity | NLGraph medium | Accuracy90.7 | 3 | |
| Connectivity | NLGraph easy | Accuracy94.8 | 3 | |
| Shortest path | NLGraph | Accuracy (0-20)91.7 | 3 | |
| Shortest path | NLGraph medium | Metric- | 0 |
Showing 14 of 14 rows