What is AI Memory? Persistent Context in LLMs

What is AI memory?

AI memory refers to mechanisms that allow LLMs to retain information across conversations. This includes conversation history, user preferences, and learned facts that persist beyond a single session.

Memory Types

Session memory: Within-conversation context
Persistent memory: Cross-session user facts
RAG memory: Retrieved from vector databases

Memory Privacy Risks

PII stored in memory systems
Memory poisoning attacks
Cross-user data leakage
Compliance with data retention policies