Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GenesisFunc: Multi-Agent Data Generation for Accurate and Generalizable Function-Calling

About

Large Language Models (LLMs) extend their capabilities through function-calling (FC), which relies on training data with high quality, diversity, and broad coverage of scenario. However, obtaining and annotating real function-calling data is challenging, while synthetic data from existing pipelines often suffers from unreliable APIs, limited tool scalability, insufficient diversity, and weak quality control. To address these, we present GenesisFunc, an automated pipeline for generating FC training data. Starting from reliable tools in widely used public benchmarks, our GenesisFunc employs a multi-agent framework to support a dialogue generation system that produces conversations spanning diverse scenarios, while maintaining both diversity and quality throughout the process. The accuracy of the data is further reinforced through a multi-stage evaluation system. We fine-tune an 8B LLM on the synthetic dataset and show through extensive experiments that it outperforms similarly sized open-source models in in-domain FC performance and out-of-domain generalization, while reaching FC capabilities comparable to some of the latest API-based models. In addition, our method demonstrates strong potential to scale effectively across downstream tools, underscoring its real-world applicability.

Hao-Xiang Xu, Chong Deng, Jiaqing Liu, Wen Wang, Qian Chen, Lujia Bao, Xiangang Li, Zhen-Hua Ling• 2026

Related benchmarks

TaskDatasetResultRank
Function CallingBFCL Live
Simple Accuracy88.25
24
Function CallingBFCL Non-Live
Simple Accuracy86.85
13
Function CallingAPI-Bank
Level-1 Score79.17
8
Function CallingACEBench Special
Overall Score83.67
8
Showing 4 of 4 rows

Other info

Follow for update