Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

IDGenRec: LLM-RecSys Alignment with Textual ID Learning

About

Generative recommendation based on Large Language Models (LLMs) have transformed the traditional ranking-based recommendation style into a text-to-text generation paradigm. However, in contrast to standard NLP tasks that inherently operate on human vocabulary, current research in generative recommendations struggles to effectively encode recommendation items within the text-to-text framework using concise yet meaningful ID representations. To better align LLMs with recommendation needs, we propose IDGen, representing each item as a unique, concise, semantically rich, platform-agnostic textual ID using human language tokens. This is achieved by training a textual ID generator alongside the LLM-based recommender, enabling seamless integration of personalized recommendations into natural language generation. Notably, as user history is expressed in natural language and decoupled from the original dataset, our approach suggests the potential for a foundational generative recommendation model. Experiments show that our framework consistently surpasses existing models in sequential recommendation under standard experimental setting. Then, we explore the possibility of training a foundation recommendation model with the proposed method on data collected from 19 different datasets and tested its recommendation performance on 6 unseen datasets across different platforms under a completely zero-shot setting. The results show that the zero-shot performance of the pre-trained foundation model is comparable to or even better than some traditional recommendation models based on supervised training, showing the potential of the IDGen paradigm serving as the foundation model for generative recommendation. Code and data are open-sourced at https://github.com/agiresearch/IDGenRec.

Juntao Tan, Shuyuan Xu, Wenyue Hua, Yingqiang Ge, Zelong Li, Yongfeng Zhang• 2024

Related benchmarks

TaskDatasetResultRank
RecommendationBeauty
Recall@105.5
39
RecommendationYelp
Recall@52.3
21
RecommendationInstruments
Recall@58.43
11
Sequential RecommendationToys In-domain (test)
Recall@55.95
7
Sequential RecommendationBeauty In-domain (test)
Recall@54.84
7
Sequential RecommendationSports In-domain (test)
Recall@50.027
7
Showing 6 of 6 rows

Other info

Follow for update