Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks

About

Agent Skills are structured packages of procedural knowledge that augment large language model (LLM) agents at inference time. Despite rapid adoption, there is no standard way to measure whether they actually help. We present SkillsBench, a benchmark whose current inventory contains 87 tasks across 8 domains paired with curated Skills and deterministic verifiers. Our latest aggregate evaluation runs the 87-task benchmark under matched no-Skills and curated-Skills conditions for 18 model-harness configurations. Curated Skills raise the average pass rate from 33.9% to 50.5% (+16.6 percentage points; 25.5% normalized gain), with configuration-level gains ranging from +4.1 to +25.7 pp. Focused Skills with at most three modules outperform larger or exhaustive bundles, and smaller models with Skills can match larger models without them. SkillsBench establishes paired evaluation as the foundation for rigorous measurement of Skill efficacy on agentic, expertise-heavy work.

Xiangyi Li, Yimin Liu, Wenbo Chen, Bingran You, Zonglin Di, Yifeng He, Shenghan Zheng, Kyoung Whan Choe, Jiankai Sun, Shuyi Wang, Chujun Tao, Binxu Li, Xuandong Zhao, Hejia Geng, Xiaojun Wu, Junwei Zhou, Xiaokun Chen, Hanwen Xing, Yubo Li, Qunhong Zeng, Di Wang, Yuanli Wang, Roey Ben Chaim, Penghao Jiang, Haotian Shen, Luyang Kong, Xinyi Liu, Runhui Wang, Xuanqing Liu, Jiachen Li, Xin Lan, Yueqian Lin, Wengao Ye, Junwei He, Songlin Li, Yue Zhang, Yipeng Gao, Yijiang Li, Ze Ma, Liqiang Jing, Tianyu Wang, Kaixin Li, Yiqi Xue, Haoran Lyu, Yizhuo He, Yuchen Tian, Shutong Wu, Bowei Wang, Yixuan Gao, Bo Chen, Litong Liu, Sikai Cheng, Jiajun Bao, Shuaicheng Tong, Shuwen Xu, Terry Yue Zhuo, Tinghan Ye, Qi Qi, Miao Li, Longtai Liao, Zelin Tan, Chang Shi, Xilin Tang, Srinath Tankasala, Boqin Yuan, Yaoyao Qian, Jianhong Tu, Chenguang Wang, Yizhou Sun, Wei Wang, Aaron Taylor, Ziyue Yang, Changkun Guan, Zhikang Dong, Xinyu Zhang, Steven Dillmann, Han-chung Lee, Dawn Song• 2026

Related benchmarks

TaskDatasetResultRank
Skill executionSkillsBench
Overall Success Rate (avg@5)43.6
26
Agent task executionSkillsBench 11 domains
Overall Score32.2
16
Skill-Augmented Agent Performance EvaluationSkillsBench 86 runnable tasks (frozen-policy transfer)
Valid Task Count76
15
Interactive Agent Task CompletionSocialMaze
Average Reward80.4
14
Interactive Agent Task CompletionScienceWorld
Average Reward88
12
Downstream task executionSkillsBench
Reward Mean (%)26.2
6
Downstream task executionAgentSkillOS
Score78.45
6
Skill-Augmented Agent Performance EvaluationSkillsBench 20-task balanced panel (held-out evaluation)
Valid Task Count18
5
Offer LetterSkillsBench
Tokens Used4.10e+4
4
Skill-assisted task executionSkillsBench 1.0 (test)
Pass@119.5
4
Showing 10 of 24 rows

Other info

GitHub

Follow for update