Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

GTM: Simulating the World of Tools for AI Agents

About

The integration of external tools is pivotal for empowering Large Language Model (LLM) agents with real-world capabilities. However, training these agents through direct, continuous interaction with diverse tools is often prohibitively expensive, slow, and introduces additional development and maintenance overhead. To address this challenge, we introduce the Generalist Tool Model (GTM), a 1.5-billion-parameter model that learns to act as a universal tool simulator. With only prompt-level configuration, GTM accesses tool functionalities along with input arguments and generates outputs that faithfully mimic real tool execution, providing a fast and cost-effective solution that eliminates development overhead. To build GTM, we propose the Context-Aware Response Generation (CARG) pipeline, which synthesizes comprehensive training data covering over 20,000 tools across 300 domains including physics, medicine, robotics, and finance. Through this pipeline, GTM learns to produce not only syntactically correct outputs but also logically coherent and contextually appropriate responses. Experiments demonstrate that GTM produces high-quality outputs with strong consistency and reliability. Besides when used in real reinforcement learning scenarios for agent training, GTM exhibits significantly faster simulation speed compared to real tools while maintaining comparable output quality, along with remarkable generalization and domain adaptability. Our results establish GTM as a foundational component for developing future AI agents, enabling efficient and scalable training of tool-augmented systems.

Zhenzhen Ren, Xinpeng Zhang, Zhenxing Qian, Yan Gao, Yu Shi, Shuxin Zheng, Jiyan He• 2025

Related benchmarks

TaskDatasetResultRank
Tool Error DetectionGTM Error Detection
Detection Rate95.3
11
Tool Response GenerationGTM Multi-turn
Format Score97.2
11
Tool Use EvaluationGTM
Average Score89.4
11
Tool Response GenerationGTM Single-turn
Format Score99.2
11
CUDA Code ValidationKernelBench Level 1
Success Rate (p=1.0)8
5
Showing 5 of 5 rows

Other info

Follow for update