Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender System

About

Collaborative filtering recommender systems (CF-RecSys) have shown successive results in enhancing the user experience on social media and e-commerce platforms. However, as CF-RecSys struggles under cold scenarios with sparse user-item interactions, recent strategies have focused on leveraging modality information of user/items (e.g., text or images) based on pre-trained modality encoders and Large Language Models (LLMs). Despite their effectiveness under cold scenarios, we observe that they underperform simple traditional collaborative filtering models under warm scenarios due to the lack of collaborative knowledge. In this work, we propose an efficient All-round LLM-based Recommender system, called A-LLMRec, that excels not only in the cold scenario but also in the warm scenario. Our main idea is to enable an LLM to directly leverage the collaborative knowledge contained in a pre-trained state-of-the-art CF-RecSys so that the emergent ability of the LLM as well as the high-quality user/item embeddings that are already trained by the state-of-the-art CF-RecSys can be jointly exploited. This approach yields two advantages: (1) model-agnostic, allowing for integration with various existing CF-RecSys, and (2) efficiency, eliminating the extensive fine-tuning typically required for LLM-based recommenders. Our extensive experiments on various real-world datasets demonstrate the superiority of A-LLMRec in various scenarios, including cold/warm, few-shot, cold user, and cross-domain scenarios. Beyond the recommendation task, we also show the potential of A-LLMRec in generating natural language outputs based on the understanding of the collaborative knowledge by performing a favorite genre prediction task. Our code is available at https://github.com/ghdtjr/A-LLMRec .

Sein Kim, Hongseok Kang, Seungyoon Choi, Donghyun Kim, Minchul Yang, Chanyoung Park• 2024

Related benchmarks

TaskDatasetResultRank
Sequential RecommendationML 1M--
150
Sequential RecommendationAmazon Arts (test)
NDCG@1049.81
50
Sequential RecommendationAmazon Toys (test)
NDCG@557.08
44
Sequential RecommendationAmazon Sports (test)
NDCG@50.5931
42
RecommendationGames
HR@150.82
19
Medical RecommendationMedicalRec II
DCG@50.0353
13
Medical RecommendationMedicalRec III
DCG@50.1073
13
RecommendationMedicalRec II
HitRate@10070.54
13
Medical RecommendationMedicalRec I
DCG@59.22
13
RecommendationMedicalRec I
HitRate@10067.3
13
Showing 10 of 24 rows

Other info

Follow for update