Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Zep: A Temporal Knowledge Graph Architecture for Agent Memory

About

We introduce Zep, a novel memory layer service for AI agents that outperforms the current state-of-the-art system, MemGPT, in the Deep Memory Retrieval (DMR) benchmark. Additionally, Zep excels in more comprehensive and challenging evaluations than DMR that better reflect real-world enterprise use cases. While existing retrieval-augmented generation (RAG) frameworks for large language model (LLM)-based agents are limited to static document retrieval, enterprise applications demand dynamic knowledge integration from diverse sources including ongoing conversations and business data. Zep addresses this fundamental limitation through its core component Graphiti -- a temporally-aware knowledge graph engine that dynamically synthesizes both unstructured conversational data and structured business data while maintaining historical relationships. In the DMR benchmark, which the MemGPT team established as their primary evaluation metric, Zep demonstrates superior performance (94.8% vs 93.4%). Beyond DMR, Zep's capabilities are further validated through the more challenging LongMemEval benchmark, which better reflects enterprise use cases through complex temporal reasoning tasks. In this evaluation, Zep achieves substantial results with accuracy improvements of up to 18.5% while simultaneously reducing response latency by 90% compared to baseline implementations. These results are particularly pronounced in enterprise-critical tasks such as cross-session information synthesis and long-term context maintenance, demonstrating Zep's effectiveness for deployment in real-world applications.

Preston Rasmussen, Pavlo Paliychuk, Travis Beauvais, Jack Ryan, Daniel Chalef• 2025

Related benchmarks

TaskDatasetResultRank
Long-term memory evaluationLocomo
Overall F143.56
70
Multi-hop Question AnsweringLocomo
F130.5
67
Long-context Question AnsweringLocomo
Average F143.56
64
Long-context Memory RetrievalLocomo
Single-hop79.43
55
Open-domain Question AnsweringLocomo
F10.242
53
Single-hop Question AnsweringLocomo
F10.455
53
Long-context reasoning and retrievalLoCoMo (test)
Single-Hop F132.9
37
Temporal Question AnsweringLocomo
F10.239
36
Long-context Memory EvaluationLongMemEval
Single-Turn Preference53.3
28
Long-term memory evaluationLongMemEval S (test)
KU (Knowledge Update)74.4
27
Showing 10 of 35 rows

Other info

Follow for update