Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SkillCAT: Contrastive Assessment and Topology-Aware Skill Self-Evolution for LLM Agents

About

Skill self-evolution methods for LLM agents aim to turn execution trajectories into reusable skill documents, but current pipelines typically learn from one trajectory per task, merge candidate skill patches before checking them, and load the full skill corpus before inference. We propose SkillCAT, a training-free framework that separates this process into three stages. Contrastive Causal Extraction (CCE) samples multiple trajectories for each task and compares same-task success/failure pairs to identify evidence that explains outcome differences. Assessment-Augmented Evolution (AAE) replays each candidate patch on source-task clones and keeps only patches that improve or preserve task outcomes before hierarchical skill patch merging. Topology-Aware Task Execution (TTE) compiles the evolved skills into a routable sub-skill topology, so inference loads only the capability nodes relevant to the task. We evaluate SkillCAT on common agent benchmarks, including SpreadsheetBench, WikiTableQuestions, and DocVQA, and further test cross-model and out-of-distribution generalization. Across these settings, SkillCAT raises the average score over baselines by up to 40.40%, demonstrating reliable skill evolution without model training.

Kunfeng Chen, Qihuang Zhong, Juhua Liu, Bo Du• 2026

Related benchmarks

TaskDatasetResultRank
Out-of-Distribution Table Question AnsweringWikiTableQuestions (WikiTQ)
WikiTQ Accuracy84.47
24
Overall Spreadsheet PerformanceSpreadsheetBench and WikiTableQuestions Combined
Average Score58.32
24
Spreadsheet Task ExecutionSpreadsheetBench Verified (Held-out)
Verification Score70.5
24
Spreadsheet Task ExecutionSpreadsheetBench Full
Soft Score47.42
24
Showing 4 of 4 rows

Other info

Follow for update