Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Consistent Client Simulation for Motivational Interviewing-based Counseling

About

Simulating human clients in mental health counseling is crucial for training and evaluating counselors (both human or simulated) in a scalable manner. Nevertheless, past research on client simulation did not focus on complex conversation tasks such as mental health counseling. In these tasks, the challenge is to ensure that the client's actions (i.e., interactions with the counselor) are consistent with with its stipulated profiles and negative behavior settings. In this paper, we propose a novel framework that supports consistent client simulation for mental health counseling. Our framework tracks the mental state of a simulated client, controls its state transitions, and generates for each state behaviors consistent with the client's motivation, beliefs, preferred plan to change, and receptivity. By varying the client profile and receptivity, we demonstrate that consistent simulated clients for different counseling scenarios can be effectively created. Both our automatic and expert evaluations on the generated counseling sessions also show that our client simulation method achieves higher consistency than previous methods.

Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, John Pinto, Jenny Giam, Kit Phey Leng, Nicholas Gabriel Lim, Cameron Tan Shi Ern, Ee-peng Lim• 2025

Related benchmarks

TaskDatasetResultRank
Turn-level language generationCounseling Session Dataset turn-level
ROUGE-129.69
6
Client SimulationCounseling Sessions
MR@200.69
6
Client SimulationAnnoMI (test)
PE70.57
5
Client SimulationAnnoMI 1.0 (test)
Personas3.33
4
Psychological Client Behavior SimulationRPC
CCR62.33
4
Client Simulation Receptivity ConsistencyAnnoMI
Avg Receptivity (Threshold 1.0)1.3
2
Showing 6 of 6 rows

Other info

Follow for update