SMILE: Single-turn to Multi-turn Inclusive Language Expansion via ChatGPT for Mental Health Support
About
Developing specialized dialogue systems for mental health support requires multi-turn conversation data, which has recently garnered increasing attention. However, gathering and releasing large-scale, real-life multi-turn conversations that could facilitate advancements in mental health support presents challenges in data privacy protection and the time and cost involved in crowdsourcing. To address these challenges, we introduce SMILE, a single-turn to multi-turn inclusive language expansion technique that prompts ChatGPT to rewrite public single-turn dialogues into multi-turn ones. Our work begins by analyzing language transformation and validating the feasibility of our proposed method. We conduct a study on dialogue diversity, including lexical features, semantic features, and dialogue topics, demonstrating the effectiveness of our method. Further, we employ our method to generate a large-scale, lifelike, and diverse dialogue dataset named SMILECHAT, consisting of 55k dialogues. Finally, we utilize the collected corpus to develop a mental health chatbot, MeChat. To better assess the quality of SMILECHAT, we collect a small-scale real-life counseling dataset conducted by data anonymization. Both automatic and human evaluations demonstrate significant improvements in our dialogue system and confirm that SMILECHAT is high-quality. Code, data, and model are publicly available at https://github.com/qiuhuachuan/smile.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Clinical Counseling Dialogue Evaluation | Session Rating Scale | Helpful Score (SRS)2.99 | 18 | |
| Emotional Support Dialogue | Cooperative Emotional Support Dialogue Average-case | Human-likeness2.44 | 17 | |
| Emotional Support Dialogue | Emotional Support Dialogue Worst-case 1.0 (test) | Human-likeness1.9 | 17 | |
| Multi-turn Psychological Counseling Dialogue Generation | CPsyCoun | ROUGE-130.71 | 16 | |
| Clinical Counseling Dialogue Evaluation | Session Rating Scale Resistant | Helpful Rating2.67 | 9 | |
| Clinical Counseling Dialogue Evaluation | Session Rating Scale Engaged | Helpful Rating3.31 | 9 | |
| Counselor Competence Assessment | Counseling Dialogues (test) | Understanding2.62 | 9 | |
| Emotional Outcome Evaluation | PANAS Positive Attitude | Positive Affect Shift2.66 | 6 | |
| Psychological Counseling Dialogue Evaluation | Multi-response competition dataset | Total Upvotes705 | 6 | |
| Clinical Competence Assessment | CTRS | Understanding4.52 | 6 |