Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Towards Open-World Recommendation with Knowledge Augmentation from Large Language Models

About

Recommender systems play a vital role in various online services. However, the insulated nature of training and deploying separately within a specific domain limits their access to open-world knowledge. Recently, the emergence of large language models (LLMs) has shown promise in bridging this gap by encoding extensive world knowledge and demonstrating reasoning capability. Nevertheless, previous attempts to directly use LLMs as recommenders have not achieved satisfactory results. In this work, we propose an Open-World Knowledge Augmented Recommendation Framework with Large Language Models, dubbed KAR, to acquire two types of external knowledge from LLMs -- the reasoning knowledge on user preferences and the factual knowledge on items. We introduce factorization prompting to elicit accurate reasoning on user preferences. The generated reasoning and factual knowledge are effectively transformed and condensed into augmented vectors by a hybrid-expert adaptor in order to be compatible with the recommendation task. The obtained vectors can then be directly used to enhance the performance of any recommendation model. We also ensure efficient inference by preprocessing and prestoring the knowledge from the LLM. Extensive experiments show that KAR significantly outperforms the state-of-the-art baselines and is compatible with a wide range of recommendation algorithms. We deploy KAR to Huawei's news and music recommendation platforms and gain a 7\% and 1.7\% improvement in the online A/B test, respectively.

Yunjia Xi, Weiwen Liu, Jianghao Lin, Xiaoling Cai, Hong Zhu, Jieming Zhu, Bo Chen, Ruiming Tang, Weinan Zhang, Rui Zhang, Yong Yu• 2023

Related benchmarks

TaskDatasetResultRank
RecommendationAmazon-Book
Recall@2016.73
36
RecommendationAmazon Review Beauty (test)
AUC0.8165
30
RecommendationAmazon Review Sports (test)
AUC81.61
30
RecommendationAmazon Review Toys (test)
AUC0.7898
30
RecommendationYelp
Recall@50.0482
17
RecommendationAmazon Office
Recall@53.51
17
RecommendationYelp
Recall@2011.94
16
Implicit Collaborative FilteringYelp 10-core (test)
R@108.62
11
Implicit Collaborative FilteringAmazon-sports 10-core (test)
Recall@1010.32
11
Implicit Collaborative FilteringAmazon-toys 10-core (test)
Recall@109.14
11
Showing 10 of 11 rows

Other info

Follow for update