Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SMILE: Single-turn to Multi-turn Inclusive Language Expansion via ChatGPT for Mental Health Support

About

Developing specialized dialogue systems for mental health support requires multi-turn conversation data, which has recently garnered increasing attention. However, gathering and releasing large-scale, real-life multi-turn conversations that could facilitate advancements in mental health support presents challenges in data privacy protection and the time and cost involved in crowdsourcing. To address these challenges, we introduce SMILE, a single-turn to multi-turn inclusive language expansion technique that prompts ChatGPT to rewrite public single-turn dialogues into multi-turn ones. Our work begins by analyzing language transformation and validating the feasibility of our proposed method. We conduct a study on dialogue diversity, including lexical features, semantic features, and dialogue topics, demonstrating the effectiveness of our method. Further, we employ our method to generate a large-scale, lifelike, and diverse dialogue dataset named SMILECHAT, consisting of 55k dialogues. Finally, we utilize the collected corpus to develop a mental health chatbot, MeChat. To better assess the quality of SMILECHAT, we collect a small-scale real-life counseling dataset conducted by data anonymization. Both automatic and human evaluations demonstrate significant improvements in our dialogue system and confirm that SMILECHAT is high-quality. Code, data, and model are publicly available at https://github.com/qiuhuachuan/smile.

Huachuan Qiu, Hongliang He, Shuai Zhang, Anqi Li, Zhenzhong Lan• 2023

Related benchmarks

TaskDatasetResultRank
Clinical Counseling Dialogue EvaluationSession Rating Scale
Helpful Score (SRS)2.99
18
Emotional Support DialogueCooperative Emotional Support Dialogue Average-case
Human-likeness2.44
17
Emotional Support DialogueEmotional Support Dialogue Worst-case 1.0 (test)
Human-likeness1.9
17
Multi-turn Psychological Counseling Dialogue GenerationCPsyCoun
ROUGE-130.71
16
Clinical Counseling Dialogue EvaluationSession Rating Scale Resistant
Helpful Rating2.67
9
Clinical Counseling Dialogue EvaluationSession Rating Scale Engaged
Helpful Rating3.31
9
Counselor Competence AssessmentCounseling Dialogues (test)
Understanding2.62
9
Emotional Outcome EvaluationPANAS Positive Attitude
Positive Affect Shift2.66
6
Psychological Counseling Dialogue EvaluationMulti-response competition dataset
Total Upvotes705
6
Clinical Competence AssessmentCTRS
Understanding4.52
6
Showing 10 of 13 rows

Other info

Follow for update