← Back to Computation and Language
cs.CL

Why agent systems fail as skill libraries grow—and how to fix it

Charles Chen, Qiming Yu, Yuhang Gu, Zhuoye Huang, Hanjing Li, Hongyu Liu, Simin Liu, Jinhao Liu, Dengyun Peng, Jiangyi Wang, Zheng Yan, Fanqing Meng, Ethan Qin, Carl Che, Mengkang Hu

May 15, 2026

This paper identifies fundamental scaling laws governing how large language model agents perform as their skill libraries grow. Across 15 models and over 3 million real decisions on 1,141 practical skills, the authors show that routing accuracy (picking the right skill) decays logarithmically with library size, while execution quality can partially compensate for routing errors. A single parameter couples these two laws, allowing predictions of downstream recoverability from routing metrics. Applying these insights to optimize skill libraries raises benchmark performance from 49.3% to 61.6% on ClawBench and 28.4% to 34.5% on ClawMark. Intended for researchers building production agent systems and practitioners deploying LLMs with tool use.
Published as The Scaling Laws of Skills in LLM Agent Systems arXiv:2605.16508
Read the original paper →