TOOLRET
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Tool retrieval | ToolRet | Avg nDCG@1045.96 | 21 | |
| Tool Retrieval | ToolRet CN v1.0 (test) | HR98 | 18 | |
| Tool Retrieval | TOOLRET Zero-Shot Macro-Avg | nDCG@1036.9 | 15 | |
| Tool Retrieval | TOOLRET Zero-Shot Custom | nDCG@1045.8 | 15 | |
| Tool Retrieval | TOOLRET Zero-Shot Code | nDCG@1032 | 15 | |
| Tool Retrieval | TOOLRET Zero-Shot Web* | nDCG@1034.9 | 15 | |
| Tool Retrieval | TOOLRET In-Domain (Avg) | nDCG@1063.1 | 15 | |
| Tool Retrieval | ToolRet (Customized) | N@1042.38 | 11 | |
| Tool Retrieval | ToolRet (Code) | N@1045.93 | 11 | |
| Tool Retrieval | ToolRet EN v1.0 (test) | Hit Rate (HR)92.6 | 9 | |
| Service Discovery | ToolRet EN | Hit Rate (%)92.6 | 5 | |
| Tool Retrieval | ToolRet 1,839 services (test) | Hit Rate92.6 | 2 |
Showing 12 of 12 rows