Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Generative Recommender with End-to-End Learnable Item Tokenization

About

Generative recommendation systems have gained increasing attention as an innovative approach that directly generates item identifiers for recommendation tasks. Despite their potential, a major challenge is the effective construction of item identifiers that align well with recommender systems. Current approaches often treat item tokenization and generative recommendation training as separate processes, which can lead to suboptimal performance. To overcome this issue, we introduce ETEGRec, a novel End-To-End Generative Recommender that unifies item tokenization and generative recommendation into a cohesive framework. Built on a dual encoder-decoder architecture, ETEGRec consists of an item tokenizer and a generative recommender. To enable synergistic interaction between these components, we propose a recommendation-oriented alignment strategy, which includes two key optimization objectives: sequence-item alignment and preference-semantic alignment. These objectives tightly couple the learning processes of the item tokenizer and the generative recommender, fostering mutual enhancement. Additionally, we develop an alternating optimization technique to ensure stable and efficient end-to-end training of the entire framework. Extensive experiments demonstrate the superior performance of our approach compared to traditional sequential recommendation models and existing generative recommendation baselines. Our code is available at https://github.com/RUCAIBox/ETEGRec.

Enze Liu, Bowen Zheng, Cheng Ling, Lantao Hu, Han Li, Wayne Xin Zhao• 2024

Related benchmarks

TaskDatasetResultRank
Sequential RecommendationAmazon Beauty (test)
NDCG@103.44
107
Sequential RecommendationSports
Recall@50.0248
43
Sequential RecommendationToys
Recall@50.0445
31
Sequential RecommendationBeauty
HR@106.68
30
Generative RecommendationBeauty
R@106.15
28
Sequential RecommendationBeauty
Recall@55.25
24
Sequential RecommendationAmazon Toys (test)
NDCG@103.21
24
Sequential RecommendationInstruments
HR@56.16
20
Generative RecommendationInstruments
R@1011.06
13
Generative RecommendationYelp
R@100.0415
13
Showing 10 of 15 rows

Other info

Follow for update