← Back to Computation and Language
cs.CL

How language agents learn to remember better by sleeping on it

Chongrui Ye, Yuxiang Liu, Yu Wang, Haofei Yu, Yining Zhao, Ge Liu, Julian McAuley, Jiaxuan You

May 20, 2026

Language agents running multiple tasks accumulate clutter in memory. Auto-Dreamer separates the quick recording of session experiences from slow offline consolidation across sessions, where it inspects old memories, finds patterns, and replaces bloated regions with compact summaries. Trained on ScienceWorld tasks using agent performance as reward, it beats all baselines while using 12× less memory on ScienceWorld and generalizes to ALFWorld and WebArena with 6× less memory than prior methods—no retraining needed.
Published as Auto-Dreamer: Learning Offline Memory Consolidation for Language Agents arXiv:2605.20616
Read the original paper →