Matt Stockton

Notes Agent design

Using past sessions to improve project memory

I use a wiki or knowledge base for my projects, and I mine past sessions to distill learnings as a batch step. A lot of Anthropic's writing about memory matched that experience.

The idea of 'dreaming' was particularly interesting to me: a periodic process that can read both the raw sessions and the memories created during those sessions. It gets a fresh context window to find mistakes, correct memories, and improve how the information is organized.

A wiki gives the model a way to navigate the information without loading everything at once. I liked the idea that repeated passes could improve the structure of the wiki itself, rather than having to prescribe that structure up front. There is still a lot to figure out here, including when the model needs to go back to the raw sessions.

Originally posted on X. Lightly edited for reading here.