Memora: A Harmonic Memory Representation Balancing Abstraction and Specificity
Menglin Xia, Xuchao Zhang, Shantanu Dixit, Paramaguru Harimurugan, Rujia Wang, Victor Ruehle, Robert A Sim, Chetan Bansal, Saravanakumar Rajmohan
Abstract
Agent memory systems must accommodate continuously growing information while supporting efficient, context-aware retrieval for downstream tasks. Abstraction is essential for scaling agent memory, yet it often comes at the cost of specificity, obscuring the fine-grained details required for effective reasoning. We introduce MEMORA, a harmonic memory representation that structurally balances abstraction and specificity. MEMORA organizes information via its primary abstractions that index concrete memory values and consolidate related updates into unified memory entries, while cue anchors expand retrieval access across diverse aspects of the memory and connect related memories. Building on this structure, we employ a retrieval policy that actively exploits these memory connections to retrieve relevant information beyond direct semantic similarity. Theoretically, we show that standard Retrieval-Augmented Generation (RAG) and Knowledge Graph (KG)-based memory systems emerge as special cases of our framework. Empirically, MEMORA establishes a new state-of-the-art on the LoCoMo and Long-MemEval benchmarks, demonstrating better retrieval relevance and reasoning effectiveness as memory scales.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Improving Language Models by Retrieving from Trillions of TokensSebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai et al.ICML 2022 · 1,629 citations
- A-Mem: Agentic Memory for LLM AgentsWujiang Xu, Zujie Liang, Kai Mei, Hang Gao et al.NeurIPS 2025 · 1,138 citations
- MemoryBank: Enhancing Large Language Models with Long-Term MemoryWanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye et al.AAAI 2024 · 394 citations
- Dense Passage Retrieval for Open-Domain Question AnsweringVladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis et al.EMNLP 2020 · 142 citations
Related papers
- HyperMem: Hypergraph Memory for Long-Term ConversationsJuwei Yue, Chuanrui Hu, Jiawei Sheng, Zuyi Zhou et al.ACL 2026 · 4 citations
- MemGraphRAG: Memory-based Multi-Agent System for Graph Retrieval-Augmented GenerationChuanjie Wu, Zhishang Xiang, Yunbo Tang, Zerui Chen et al.KDD 2026 · 1 citation
- PlugMem: A Task-Agnostic Plugin Memory Module for LLM AgentsKe Yang, Zixi Chen, Xuan He, Jize Jiang et al.ICML 2026 · 20 citations
- MAGMA: A Multi-Graph based Agentic Memory Architecture for AI AgentsDongming Jiang, Yi Li, Guanpeng Li, Bingzhe LiACL 2026 · 32 citations
- APEX-MEM: Agentic Semi-Structured Memory with Temporal Reasoning for Long-Term Conversational AIPratyay Banerjee, Masud Moshtaghi, Shivashankar Subramanian, Amita Misra et al.ACL 2026 · 1 citation
