Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation

About

Sequential Recommendation (SeqRec) aims to predict the next item by capturing sequential patterns from users' historical interactions, playing a crucial role in many real-world recommender systems. However, existing approaches predominantly adopt a direct forward computation paradigm, where the final hidden state of the sequence encoder serves as the user representation. We argue that this inference paradigm, due to its limited computational depth, struggles to model the complex evolving nature of user preferences and lacks a nuanced understanding of long-tail items, leading to suboptimal performance. To address this issue, we propose \textbf{ReaRec}, the first inference-time computing framework for recommender systems, which enhances user representations through implicit multi-step reasoning. Specifically, ReaRec autoregressively feeds the sequence's last hidden state into the sequential recommender while incorporating special reasoning position embeddings to decouple the original item encoding space from the multi-step reasoning space. Moreover, we introduce two lightweight reasoning-based learning methods, Ensemble Reasoning Learning (ERL) and Progressive Reasoning Learning (PRL), to further effectively exploit ReaRec's reasoning potential. Extensive experiments on five public real-world datasets and different SeqRec architectures demonstrate the generality and effectiveness of our proposed ReaRec. Remarkably, post-hoc analyses reveal that ReaRec significantly elevates the performance ceiling of multiple sequential recommendation backbones by approximately 30\%-50\%. Thus, we believe this work can open a new and promising avenue for future research in inference-time computing for sequential recommendation.

Jiakai Tang, Sunhao Dai, Teng Shi, Jun Xu, Xu Chen, Wen Chen, Jian Wu, Yuning Jiang• 2025

Related benchmarks

TaskDatasetResultRank
Sequential RecommendationAmazon Beauty (test)
NDCG@103.44
107
Sequential RecommendationYelp
Recall@100.0621
80
Sequential RecommendationSports
Recall@104.75
62
Sequential RecommendationBeauty
Recall@106.86
42
Sequential RecommendationToys
Recall@51.02
31
Sequential RecommendationAmazon Toys (test)
NDCG@103.57
24
Sequential RecommendationAmazon CDs and Vinyl (test)
NDCG@102.85
22
Sequential RecommendationCDs
Recall@52.27
21
Sequential RecommendationToys (test)
Recall@102.63
21
Sequential RecommendationToys
Recall@107.23
20
Showing 10 of 52 rows

Other info

Follow for update