2025/12/25 by Changzhi Sun, Sun, Changzhi, Xiangyu Chen +7 · 1 citation
Computer Science · Decision Sciences · #Aggregate (composite) #Cognitive reframing #Component (thermodynamics) #Computation and Language (cs.CL) #Constraint Satisfaction and Optimization #Encoding (memory) #FOS: Computer and information sciences #Heuristic #Key (lock) #Memory management #Memory model #Personal Information Management and User Behavior #Speech and dialogue systems
paper · open access · doi:10.48550/arxiv.2512.21567
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2025/12/25 · openalex created_date 2025/12/30 · openalex updated_date 2026/07/28
External memory is a key component of modern large language model (LLM) systems, enabling long-term interaction and personalization. Despite its importance, memory management is still largely driven by hand-designed heuristics, offering little insight into the long-term and uncertain consequences of memory decisions. In practice, choices about what to read or write shape future retrieval and downstream behavior in ways that are difficult to anticipate. We argue that memory management should be viewed as a sequential decision-making problem under uncertainty, where the utility of memory is delayed and dependent on future interactions. To this end, we propose DAM (Decision-theoretic Agent Memory), a decision-theoretic framework that decomposes memory management into immediate information access and hierarchical storage maintenance. Within this architecture, candidate operations are evaluated via value functions and uncertainty estimators, enabling an aggregate policy to arbitrate decisions based on estimated long-term utility and risk. Our contribution is not a new algorithm, but a principled reframing that clarifies the limitations of heuristic approaches and provides a foundation for future research on uncertainty-aware memory systems.