Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ANDES: Agent Native Data Evolving Synthesis Tool for Autonomous Instruction Alignment

About

AI agents are increasingly being tasked with automating AI research itself, particularly the critical post-training phase that transforms base LLMs into aligned assistants. However, recent evaluations reveal that even frontier agents struggle to perform this task. While the success of post-training fundamentally relies on acquiring high-quality data, relying on agents to autonomously curate targeted training datasets from the open web introduces severe challenges. Executing the long-horizon tasks of searching, filtering, and balancing data within noisy web environments frequently overwhelms an agent's limited context, ultimately leading to degraded dataset quality and suboptimal downstream training performance. To bridge this gap, we introduce Andes (Agent Native Data Evolving Synthesis), a framework that reimagines data generation as a plug-and-play \emph{agent skill}. Rather than forcing agents to devise complex data-gathering strategies from scratch, \textsc{Andes} provides an intelligent abstraction layer. By leveraging a self-evolving World Tree routing mechanism and actionable diagnostic reports, it allows trainer agents to dynamically steer data synthesis through an interactive, closed-loop interface. We demonstrate that under strict compute constraints, equipping foundationally weaker agents with Andes improves automated alignment, securing state-of-the-art performance on PostTrainBench and robust cross-task generalization. Our project is available at https://github.com/zzy1127/ANDES.

Zhengyang Zhao, Shengjie Ye, Lu Ma, Hao Liang, Hengyi Feng, Wentao Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Multi-task Language UnderstandingMMLU
MMLU Accuracy74.8
442
Mathematical ReasoningAIME 2025
Accuracy6.6
311
Grade School Math ReasoningGSM8K
Accuracy (GSM8K)67.52
138
Scientific ReasoningGPQA Main
Accuracy27.03
101
Tool UseBFCL
Accuracy89
45
Multi-task EvaluationPostTrainBench
AIME 25 Score4.6
41
Multi-task Language UnderstandingCEval
Accuracy82.4
22
Medical and Health KnowledgeHealthBench
Accuracy37.2
17
Comprehensive LLM EvaluationPostTrainBench (test)
AIME 20259
17
General Reasoning AveragePostTrainBench
Average (%)31.91
17
Showing 10 of 15 rows

Other info

Follow for update