Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Contrastive Self-supervised Sequential Recommendation with Robust Augmentation

About

Sequential Recommendationdescribes a set of techniques to model dynamic user behavior in order to predict future interactions in sequential user data. At their core, such approaches model transition probabilities between items in a sequence, whether through Markov chains, recurrent networks, or more recently, Transformers. However both old and new issues remain, including data-sparsity and noisy data; such issues can impair the performance, especially in complex, parameter-hungry models. In this paper, we investigate the application of contrastive Self-Supervised Learning (SSL) to the sequential recommendation, as a way to alleviate some of these issues. Contrastive SSL constructs augmentations from unlabelled instances, where agreements among positive pairs are maximized. It is challenging to devise a contrastive SSL framework for a sequential recommendation, due to its discrete nature, correlations among items, and skewness of length distributions. To this end, we propose a novel framework, Contrastive Self-supervised Learning for sequential Recommendation (CoSeRec). We introduce two informative augmentation operators leveraging item correlations to create high-quality views for contrastive learning. Experimental results on three real-world datasets demonstrate the effectiveness of the proposed method on improving model performance and the robustness against sparse and noisy data. Our implementation is available online at \url{https://github.com/YChen1993/CoSeRec}

Zhiwei Liu, Yongjun Chen, Jia Li, Philip S. Yu, Julian McAuley, Caiming Xiong• 2021

Related benchmarks

TaskDatasetResultRank
Sequential RecommendationML 1M
NDCG@100.0981
130
Sequential RecommendationYelp
Recall@100.0397
120
Sequential RecommendationAmazon Beauty
NDCG@103.02
84
Sequential RecommendationYelp (Overall)
Hit Rate @100.0296
63
Sequential RecommendationBeauty
HR@107.72
58
Sequential RecommendationAmazon Toys
R@100.0877
51
Sequential RecommendationSports
Recall@50.0292
43
Sequential RecommendationBeauty
Hit Rate @ 200.1031
43
Sequential RecommendationSports
HR@52.85
39
Sequential RecommendationBeauty (test)
NDCG@53.03
36
Showing 10 of 25 rows

Other info

Follow for update