Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MentalAgora: A Gateway to Advanced Personalized Care in Mental Health through Multi-Agent Debating and Attribute Control

About

As mental health issues globally escalate, there is a tremendous need for advanced digital support systems. We introduce MentalAgora, a novel framework employing large language models enhanced by interaction between multiple agents for tailored mental health support. This framework operates through three stages: strategic debating, tailored counselor creation, and response generation, enabling the dynamic customization of responses based on individual user preferences and therapeutic needs. We conduct experiments utilizing a high-quality evaluation dataset TherapyTalk crafted with mental health professionals, shwoing that MentalAgora generates expert-aligned and user preference-enhanced responses. Our evaluations, including experiments and user studies, demonstrate that MentalAgora aligns with professional standards and effectively meets user preferences, setting a new benchmark for digital mental health interventions.

Yeonji Lee, Sangjun Park, Kyunghyun Cho, JinYeong Bak• 2024

Related benchmarks

TaskDatasetResultRank
LLM-as-a-JudgePeer-Support Evaluation Set
Empathy4.88
23
Empathetic Response GenerationReddiSupp (Expert Evaluation)
Empathy3.37
4
Empathetic Response GenerationReddiSupp User Study (test)
Empathy3.24
4
Showing 3 of 3 rows

Other info

Follow for update