Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Personalizing Dialogue Agents: I have a dog, do you have pets too?

About

Chit-chat models are known to have several problems: they lack specificity, do not display a consistent personality and are often not very captivating. In this work we present the task of making chit-chat more engaging by conditioning on profile information. We collect data and train models to (i) condition on their given profile information; and (ii) information about the person they are talking to, resulting in improved dialogues, as measured by next utterance prediction. Since (ii) is initially unknown our model is trained to engage its partner with personal topics, and we show the resulting dialogue can be used to predict profile information about the interlocutors.

Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, Jason Weston• 2018

Related benchmarks

TaskDatasetResultRank
Dialogue GenerationPersonaChat (test)
Persona Consistency0.15
27
Personalized Dialogue GenerationPersonaChat (Human Evaluation)
Fluency3.04
16
Dialogue GenerationPERSONA-CHAT original (dev)
Hits@154.8
13
Dialogue GenerationPERSONA-CHAT Revised (dev)
Hits@138.1
11
Human Evaluation of DialoguePersona-Chat 1.0 (test)
Fluency3.97
9
Knowledge-Grounded ConversationPersonalized KGC dataset (test)
BLEU-13.87
9
Profile PredictionPersona-Chat
Error Rate (Profile)1.1
8
Dialog utterance predictionPERSONA-CHAT No Persona v1
Hits@10.349
6
Dialog utterance predictionPERSONA-CHAT Original v1
Hits@151.1
6
Dialog utterance predictionPERSONA-CHAT Revised v1
Hits@10.354
6
Showing 10 of 12 rows

Other info

Code

Follow for update