Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MACRec: a Multi-Agent Collaboration Framework for Recommendation

About

LLM-based agents have gained considerable attention for their decision-making skills and ability to handle complex tasks. Recognizing the current gap in leveraging agent capabilities for multi-agent collaboration in recommendation systems, we introduce MACRec, a novel framework designed to enhance recommendation systems through multi-agent collaboration. Unlike existing work on using agents for user/item simulation, we aim to deploy multi-agents to tackle recommendation tasks directly. In our framework, recommendation tasks are addressed through the collaborative efforts of various specialized agents, including Manager, User/Item Analyst, Reflector, Searcher, and Task Interpreter, with different working flows. Furthermore, we provide application examples of how developers can easily use MACRec on various recommendation tasks, including rating prediction, sequential recommendation, conversational recommendation, and explanation generation of recommendation results. The framework and demonstration video are publicly available at https://github.com/wzf2000/MACRec.

Zhefan Wang, Yuanqing Yu, Wendi Zheng, Weizhi Ma, Min Zhang• 2024

Related benchmarks

TaskDatasetResultRank
RecommendationMovieLens 1M
nDCG@1042.7
49
RecommendationAmazon Electronics
HR@1046.2
14
Explanation GenerationAmazon Electronics
Faithfulness69.3
7
Multi-Stakeholder RecommendationCDs & Vinyl
NDCG44.5
6
Multi-Stakeholder RecommendationMovies & TV
NDCG41.63
6
Multi-Stakeholder RecommendationGoodreads YA
NDCG51.34
6
RecommendationYelp
HR@1044.2
6
Multi-Stakeholder RecommendationSteam Games
NDCG31.21
6
Explainable RecommendationThree recommendation datasets (test)
Latency (s)4.1
6
Recommendation Explanation EvaluationHuman Expert Evaluation Set Aggregated (test)
Helpfulness Score3.56
5
Showing 10 of 10 rows

Other info

Follow for update