Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ConvMemory: A Lightweight Learned Memory Reranker, a Negative Attribution Result, and a Research-Preview Conflict Editor

About

We describe ConvMemory, a small 3.6M-parameter learned reranker for conversational long-term memory retrieval, trained with cross-encoder teacher supervision over fused dense and lexical features. On the LongMemEval memory family, ConvMemory operates above the BGE-large cross-encoder in Recall@10 at 12-47x lower latency, remains within 0.025 Recall@10 of mxbai-rerank-large-v1 on Clean500 while running 28x cheaper; under Stress1000 distractors the Recall@10 gap widens to 0.081 but ConvMemory still operates at 117x lower latency; these LongMemEval numbers are single-run or single-seed and are reported as indicative cost-frontier evidence, not benchmark-grade. We then publish a rigorous negative attribution result on a previously claimed mechanism: a five-seed retrained ablation with paired bootstrap shows that ConvMemory's learned temporal window is statistically significant on aggregate but not temporally specific, with the largest effects on hard non-temporal controls and no significant effect on multi-hop temporal queries. The honest description of the mechanism is cheap cross-encoder distillation in a fused dense+lexical feature space, not temporal-structure exploitation. We additionally release CCGE-LA, a low-amplitude conflict-aware candidate-set editor over ConvMemory, as a research preview with modest but consistent gains on supersession and stale/rescue slices on LoCoMo. All results are retrieval-stage; ConvMemory does not match mxbai-rerank-large-v1 in absolute LoCoMo MRR, and the report is single-author and not yet independently audited.

Taiheng Pan• 2026

Related benchmarks

TaskDatasetResultRank
RetrievalHotpotQA--
68
Synthetic memory retrievalV142 synthetic
R@194.75
8
Conversational Memory RetrievalLongMemEval Clean500
Recall@1095.93
5
RerankingLocomo
Recall@1077.98
5
RetrievalQMSum
R@1058.82
4
Conversational Memory RetrievalLongMemEval Stress1000 seed 23
Recall@1073.86
4
RetrievalMSC persona
R@1096.32
4
RetrievalMuSiQue
Recall@1076.35
4
Conversational Memory RetrievalLoCoMo alpha (FULL)
MRR56.38
1
Conversational Memory RetrievalLoCoMo alpha (T_SUP_auto)
MRR55.08
1
Showing 10 of 12 rows

Other info

Follow for update