← Back to Computation and Language cs.CL
How agents learn and remember winning strategies across tasks
Zixuan Zhu, Yitong Hu, Yong Dai, Junfeng Fang, Chunyang Jiang, Senkang Hu, Yuzhi Zhao
June 1, 2026
LLM agents solve tasks step-by-step but forget useful strategies once each episode ends. Unified Context Evolution organizes agent experience into four knowledge types—Memory, Strategy, Workflow, Skill—stored in an evolving library that agents retrieve and refine through repeated use. The system learns which knowledge types need reinforcement and automatically strengthens weak areas. On standard benchmarks, it improves task success substantially (96.3% on ALFWorld, up from 75.4%), and learned libraries transfer to different agent models without retraining.
Read the original paper →