Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Tool Graph Retriever: Exploring Dependency Graph-based Tool Retrieval for Large Language Models

About

With the remarkable advancement of AI agents, the number of their equipped tools is increasing rapidly. However, integrating all tool information into the limited model context becomes impractical, highlighting the need for efficient tool retrieval methods. In this regard, dominant methods primarily rely on semantic similarities between tool descriptions and user queries to retrieve relevant tools. However, they often consider each tool independently, overlooking dependencies between tools, which may lead to the omission of prerequisite tools for successful task execution. To deal with this defect, in this paper, we propose Tool Graph Retriever (TGR), which exploits the dependencies among tools to learn better tool representations for retrieval. First, we construct a dataset termed TDI300K to train a discriminator for identifying tool dependencies. Then, we represent all candidate tools as a tool dependency graph and use graph convolution to integrate the dependencies into their representations. Finally, these updated tool representations are employed for online retrieval. Experimental results on several commonly used datasets show that our TGR can bring a performance improvement to existing dominant methods, achieving SOTA performance. Moreover, in-depth analyses also verify the importance of tool dependencies and the effectiveness of our TGR.

Linfeng Gao, Yaoxiang Wang, Minlong Peng, Jialong Tang, Yuzhe Shang, Mingming Sun, Jinsong Su• 2025

Related benchmarks

TaskDatasetResultRank
Function SelectionTinyAgent
Function Selection Accuracy21.5
50
Function SelectionTaskBench HuggingFace
Function Selection Accuracy14.6
45
Tool Retrieval and Function SelectionTaskbench-HF
MRR0.37
18
Tool Retrieval and Function SelectionTinyAgent
Function Selection Accuracy0.215
9
Tool Retrieval and Function SelectionTaskbench DL
Function Selection Accuracy13.3
9
Tool Retrieval and Function SelectionTaskbench-MM
Function Selection Accuracy5.3
9
Tool RetrievalTinyAgent
MRR18
9
Showing 7 of 7 rows

Other info

Follow for update