Observability & Debugging Memory: Logs, Traces, and Evaluation
Observability & Debugging Memory: Logs, Traces, and Evaluation
Why memory bugs are painful
When an agent fails because it “remembered wrong”, the issue is often hidden in retrieval ranking or an incorrect write.
What to log
- Memory queries
- Top-k retrieved items with scores
- Filters applied
- Final context injected into the prompt
Evaluation metrics
- Retrieval precision (was retrieved memory actually used?)
- Staleness rate
- Memory conflict rate
- User correction rate
Debug workflow
- Reproduce with the same query
- Inspect retrieved memories
- Check write source and timestamp
- Adjust ranking / filters
