Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

User Behavior Simulation with Large Language Model based Agents

About

Simulating high quality user behavior data has always been a fundamental problem in human-centered applications, where the major difficulty originates from the intricate mechanism of human decision process. Recently, substantial evidences have suggested that by learning huge amounts of web knowledge, large language models (LLMs) can achieve human-like intelligence. We believe these models can provide significant opportunities to more believable user behavior simulation. To inspire such direction, we propose an LLM-based agent framework and design a sandbox environment to simulate real user behaviors. Based on extensive experiments, we find that the simulated behaviors of our method are very close to the ones of real humans. Concerning potential applications, we simulate and study two social phenomenons including (1) information cocoons and (2) user conformity behaviors. This research provides novel simulation paradigms for human-centered applications.

Lei Wang, Jingsen Zhang, Hao Yang, Zhiyuan Chen, Jiakai Tang, Zeyu Zhang, Xu Chen, Yankai Lin, Ruihua Song, Wayne Xin Zhao, Jun Xu, Zhicheng Dou, Jun Wang, Ji-Rong Wen• 2023

Related benchmarks

TaskDatasetResultRank
Next Action PredictionOPeRA (test)
Action Generation Acc22.71
18
Binary ClassificationSteam
Accuracy62.67
15
Binary ClassificationMovieLens
Accuracy58.07
15
Binary ClassificationAmazonBook
Accuracy62.22
15
Rating PredictionMovieLens
RMSE1.1021
8
Rating PredictionAmazonBook
RMSE1.2587
8
Rating PredictionSteam
RMSE1.0766
8
Reasoning and Persona ConsistencyOPeRA (test)
Pages per Session3.5
7
Showing 8 of 8 rows

Other info

Follow for update