Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Role-Play with Large Language Models

About

As dialogue agents become increasingly human-like in their performance, it is imperative that we develop effective ways to describe their behaviour in high-level terms without falling into the trap of anthropomorphism. In this paper, we foreground the concept of role-play. Casting dialogue agent behaviour in terms of role-play allows us to draw on familiar folk psychological terms, without ascribing human characteristics to language models they in fact lack. Two important cases of dialogue agent behaviour are addressed this way, namely (apparent) deception and (apparent) self-awareness.

Murray Shanahan, Kyle McDonell, Laria Reynolds• 2023

Related benchmarks

TaskDatasetResultRank
Prosocial Safety AssessmentProsocial
MAE0.9286
14
Safety AssessmentSafety Avg.
MAE3.063
14
Showing 2 of 2 rows

Other info

Follow for update