Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation

About

Sequential Recommendation (SeqRec) aims to predict the next item by capturing sequential patterns from users' historical interactions, playing a crucial role in many real-world recommender systems. However, existing approaches predominantly adopt a direct forward computation paradigm, where the final hidden state of the sequence encoder serves as the user representation. We argue that this inference paradigm, due to its limited computational depth, struggles to model the complex evolving nature of user preferences and lacks a nuanced understanding of long-tail items, leading to suboptimal performance. To address this issue, we propose \textbf{ReaRec}, the first inference-time computing framework for recommender systems, which enhances user representations through implicit multi-step reasoning. Specifically, ReaRec autoregressively feeds the sequence's last hidden state into the sequential recommender while incorporating special reasoning position embeddings to decouple the original item encoding space from the multi-step reasoning space. Moreover, we introduce two lightweight reasoning-based learning methods, Ensemble Reasoning Learning (ERL) and Progressive Reasoning Learning (PRL), to further effectively exploit ReaRec's reasoning potential. Extensive experiments on five public real-world datasets and different SeqRec architectures demonstrate the generality and effectiveness of our proposed ReaRec. Remarkably, post-hoc analyses reveal that ReaRec significantly elevates the performance ceiling of multiple sequential recommendation backbones by approximately 30\%-50\%. Thus, we believe this work can open a new and promising avenue for future research in inference-time computing for sequential recommendation.

Jiakai Tang, Sunhao Dai, Teng Shi, Jun Xu, Xu Chen, Wen Chen, Jian Wu, Yuning Jiang• 2025

Related benchmarks

TaskDatasetResultRank
Sequential RecommendationYelp
Recall@100.0621
120
Sequential RecommendationAmazon Beauty (test)
NDCG@103.44
117
Sequential RecommendationSports
Recall@104.75
62
Sequential RecommendationBeauty
Recall@106.86
42
Sequential RecommendationToys
Recall@51.02
42
Sequential RecommendationToys (test)
NDCG@101.43
36
Sequential RecommendationAmazon Office (test)
NDCG@1034.57
31
Sequential RecommendationMicroLens (test)
Recall@50.22
31
Sequential RecommendationAmazon Toys (test)
NDCG@103.57
24
Sequential RecommendationAmazon CDs and Vinyl (test)
NDCG@102.85
22
Showing 10 of 58 rows

Other info

Follow for update