Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Hello Again! LLM-powered Personalized Agent for Long-term Dialogue

About

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the real-world demands for long-term companionship and personalized interactions with chatbots. Crucial to addressing this real-world need are event summary and persona management, which enable reasoning for appropriate long-term dialogue responses. Recent progress in the human-like cognitive and reasoning capabilities of LLMs suggests that LLM-based agents could significantly enhance automated perception, decision-making, and problem-solving. In response to this potential, we introduce a model-agnostic framework, the Long-term Dialogue Agent (LD-Agent), which incorporates three independently tunable modules dedicated to event perception, persona extraction, and response generation. For the event memory module, long and short-term memory banks are employed to separately focus on historical and ongoing sessions, while a topic-based retrieval mechanism is introduced to enhance the accuracy of memory retrieval. Furthermore, the persona module conducts dynamic persona modeling for both users and agents. The integration of retrieved memories and extracted personas is subsequently fed into the generator to induce appropriate responses. The effectiveness, generality, and cross-domain capabilities of LD-Agent are empirically demonstrated across various illustrative benchmarks, models, and tasks. The code is released at https://github.com/leolee99/LD-Agent.

Hao Li, Chenghao Yang, An Zhang, Yang Deng, Xiang Wang, Tat-Seng Chua• 2024

Related benchmarks

TaskDatasetResultRank
Safety EvaluationPS-Bench base setting (test)
ASR (Hate Speech)21.7
30
Dialogue Response GenerationMSC Session 3
BLEU-1 Score22.45
10
Dialogue Memory RetrievalLME N=50
Recall@147
7
Question AnsweringSRQA
F1 Score73.1
7
Question AnsweringSimpleQA
F1 Score51.7
7
Question AnsweringCoQA
F1 Score (CoQA)77.6
7
Dialogue Response GenerationMSC Session 2
BLEU-119.54
5
Dialogue GenerationLoCoMo Large-Scale (N=50)
BLEU-121.49
5
Dialogue Response GenerationMSC Session 4
BLEU-119.23
5
Dialogue Response GenerationMSC Session 5
BLEU-119.77
5
Showing 10 of 22 rows

Other info

Follow for update