Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agents

About

Long-term human-agent dialogues are organized by topic continuity: adjacent turns often develop the same goal, plan, problem, or event, while related activities may recur across distant sessions. Yet many LLM agent memory systems first decompose histories into isolated turns or fixed-size chunks, then compensate through enrichment, consolidation, or retrieval mechanisms still tied to semantic proximity or fragment-level records. This weakens temporal and causal organization and biases memory access toward semantic proximity rather than task- or topic-level continuity. We introduce \emph{Membox}, a hierarchical memory architecture that instantiates topic continuity as an explicit organization layer for agent memory. Its \textbf{Topic Loom} incrementally organizes dialogue streams into boxes whose internal turns follow the same local topic, while its \textbf{Trace Weaver} links extracted events across boxes into macro-topic traces that recover recurring activities, goals, and factual developments across distant sessions. On LoCoMo, Topic-Loom-only retrieval improves over the best Mem0/A-MEM retrieval-depth setting by 13.00 F1 points (53.95 vs. 40.95), and trace-expanded retrieval further raises F1 to 55.28; with GPT-4o, trace-expanded retrieval reaches 59.71 F1. Additional DialSim results show the same gain from adding cross-box traces in multi-party dialogue. These results show that local topic-continuity organization and macro-topic trace expansion improve long-range memory beyond semantic retrieval over fragmented records.

Dehao Tao, Guoliang Ma, Yongfeng Huang, Minghu Jiang• 2026

Related benchmarks

TaskDatasetResultRank
Long-context Question AnsweringLocomo
F1 (Multi Hop)39.88
174
Multi-hop Question AnsweringLocomo
F148.35
125
Single-hop Question AnsweringLocomo
F10.6169
111
Open-domain Question AnsweringLocomo
F10.3061
111
Temporal ReasoningLocomo
F1 Score65.06
45
Showing 5 of 5 rows

Other info

Follow for update