Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Next Interest Flow: A Generative Pre-training Paradigm for Recommender Systems by Modeling All-domain Movelines

About

Click-Through Rate (CTR) prediction has long been dominated by discriminative paradigms that optimize local decision boundaries within candidate-specific subspaces. However, these models often fail to capture the global joint distribution and the continuous structural evolution of user intent across all-domain movelines. While generative approaches attempt to model global transition patterns, existing methods suffer from discretization-induced information collapse by remapping nuanced e-commerce signals into discrete linguistic or categorical spaces, failing to preserve the topological fidelity of interest trajectories. To overcome these limitations, we propose a novel generative pre-training paradigm that models user intent as a continuous evolutionary trajectory on a high-dimensional latent interest manifold, termed the Next Interest Flow (NIF). We introduce kinematic constraints to govern this flow: Interest Diversity is achieved via tangent space decomposition, while Evolution Velocity ensures trajectory smoothness through geodesic regularization. To bridge the objective mismatch between generative pre-training and discriminative fine-tuning, we propose a bidirectional alignment strategy to synchronize semantic spaces. Furthermore, we develop a Temporal Sequential Pairwise (TSP) mechanism to instill temporal causality within the discriminative framework. We present the All-domain Moveline Evolution Network (AMEN), a unified framework implementing this pipeline. Extensive experiments on a 6.7-billion instance industrial dataset and online A/B tests on Taobao validate AMEN's superiority, achieving +0.87pt AUC gain and +11.6\% CTCVR lift.

Chen Gao, Zixin Zhao, Lv Shao, Tong Liu• 2025

Related benchmarks

TaskDatasetResultRank
Click-Through Rate PredictionTaobao industrial dataset (Offline)
AUC77.08
12
RecommendationTaobao Feeds Online A/B Testing
CTCVR11.6
1
RecommendationTaobao Floors Online A/B Testing
CTCVR Relative Lift4.2
1
RecommendationTaobao Online A/B Testing (Full Traffic)
CTCVR2.28
1
Showing 4 of 4 rows

Other info

Follow for update