Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PsyDT: Using LLMs to Construct the Digital Twin of Psychological Counselor with Personalized Counseling Style for Psychological Counseling

About

Currently, large language models (LLMs) have made significant progress in the field of psychological counseling. However, existing mental health LLMs overlook a critical issue where they do not consider the fact that different psychological counselors exhibit different personal styles, including linguistic style and therapy techniques, etc. As a result, these LLMs fail to satisfy the individual needs of clients who seek different counseling styles. To help bridge this gap, we propose PsyDT, a novel framework using LLMs to construct the Digital Twin of Psychological counselor with personalized counseling style. Compared to the time-consuming and costly approach of collecting a large number of real-world counseling cases to create a specific counselor's digital twin, our framework offers a faster and more cost-effective solution. To construct PsyDT, we utilize dynamic one-shot learning by using GPT-4 to capture counselor's unique counseling style, mainly focusing on linguistic style and therapy techniques. Subsequently, using existing single-turn long-text dialogues with client's questions, GPT-4 is guided to synthesize multi-turn dialogues of specific counselor. Finally, we fine-tune the LLMs on the synthetic dataset, PsyDTCorpus, to achieve the digital twin of psychological counselor with personalized counseling style. Experimental results indicate that our proposed PsyDT framework can synthesize multi-turn dialogues that closely resemble real-world counseling cases and demonstrate better performance compared to other baselines, thereby show that our framework can effectively construct the digital twin of psychological counselor with a specific counseling style.

Haojie Xie, Yirong Chen, Xiaofen Xing, Jingkai Lin, Xiangmin Xu• 2024

Related benchmarks

TaskDatasetResultRank
Cognitive Distortion DiagnoseCogBiasESC (test)
Precision27.6
18
InterventionCogBiasESC (test)
CogA (GPT)1.97
18
Emotional Support DialogueCooperative Emotional Support Dialogue Average-case
Human-likeness4.56
17
Emotional Support DialogueEmotional Support Dialogue Worst-case 1.0 (test)
Human-likeness2.34
17
Multi-turn Psychological Counseling Dialogue GenerationCPsyCoun
ROUGE-136.03
16
Psychological CounselingCPsyCounR Multi-Session
Coherence (Coh)1.66
12
Psychological CounselingCPsyCounR Single-Session
T.Alli0.963
12
Therapeutic Competence EvaluationPSYCHEPASS
Elo Score89
12
Multi-session Psychological CounselingPsychEval
Counselor-level Shared Score6.1
10
Clinical Competence AssessmentCTRS
Understanding4.88
6
Showing 10 of 17 rows

Other info

Code

Follow for update