Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation

About

Sequential Recommendation (SeqRec) aims to predict the next item by capturing sequential patterns from users' historical interactions, playing a crucial role in many real-world recommender systems. However, existing approaches predominantly adopt a direct forward computation paradigm, where the final hidden state of the sequence encoder serves as the user representation. We argue that this inference paradigm, due to its limited computational depth, struggles to model the complex evolving nature of user preferences and lacks a nuanced understanding of long-tail items, leading to suboptimal performance. To address this issue, we propose \textbf{ReaRec}, the first inference-time computing framework for recommender systems, which enhances user representations through implicit multi-step reasoning. Specifically, ReaRec autoregressively feeds the sequence's last hidden state into the sequential recommender while incorporating special reasoning position embeddings to decouple the original item encoding space from the multi-step reasoning space. Moreover, we introduce two lightweight reasoning-based learning methods, Ensemble Reasoning Learning (ERL) and Progressive Reasoning Learning (PRL), to further effectively exploit ReaRec's reasoning potential. Extensive experiments on five public real-world datasets and different SeqRec architectures demonstrate the generality and effectiveness of our proposed ReaRec. Remarkably, post-hoc analyses reveal that ReaRec significantly elevates the performance ceiling of multiple sequential recommendation backbones by approximately 30\%-50\%. Thus, we believe this work can open a new and promising avenue for future research in inference-time computing for sequential recommendation.

Jiakai Tang, Sunhao Dai, Teng Shi, Jun Xu, Xu Chen, Wen Chen, Jian Wu, Yuning Jiang• 2025

Related benchmarks

TaskDatasetResultRank
Sequential RecommendationAmazon Beauty (test)
NDCG@103.44
170
Sequential RecommendationAmazon Beauty
NDCG@102.55
136
Sequential RecommendationYelp
NDCG@100.0385
131
Sequential RecommendationSports
Recall@104.75
62
Sequential RecommendationAmazon Sports
NDCG@101.12
58
Sequential RecommendationBeauty
Recall@106.86
42
Sequential RecommendationToys
Recall@51.02
42
Sequential RecommendationAmazon Office (test)
NDCG@1034.57
38
Sequential RecommendationAmazon Toys (test)
NDCG@103.57
37
Sequential RecommendationOFFICE
NDCG@101.07
36
Showing 10 of 65 rows

Other info

Follow for update