Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MARS: Multi-rate Aggregation of Recency Signals for Sequential Recommendation across Sparse and Dense Regimes

About

Sequential recommenders weight historical interactions either through positional self-attention as in Transformers or through a single implicit decay schedule as in State-Space Models. Neither makes the multi-scale temporal structure of real user behaviour explicit. We propose MARS, an encoder-agnostic aggregation operator that consumes real timestamps and produces K summaries emphasising distinct recency scales, fused by a context-adaptive gate. MARS adds at most 6% parameters and runs in $\mathcal{O}(LdK)$ time. MARS adapts to data density by automatically selecting between two encoder instantiations: MARS-T (Transformer) for sparse data and MARS-M (Mamba) for dense data, based on the average sequence length of the training set. On five public benchmarks against ten Transformer- and Mamba-based baselines under a unified RecBole protocol, MARS attains the best HR@10 on every benchmark, with mean relative gain +19.7% over the strongest content-only Transformer baseline on sparse data (reaching +36.2% on Games) and +3.2% HR@10 / +0.9% NDCG over SIGMA on dense ML-1M at 42% fewer MFLOPs, occupying the accuracy-efficiency Pareto frontier across the data-density spectrum. A backbone-only ablation isolates the marginal contribution of MARS at +4% to +19% HR@10 on sparse data and motivates the dual-instantiation design. The code is included in the supplementary material.

Zhenyu Yu, Shuigeng Zhou• 2026

Related benchmarks

TaskDatasetResultRank
Sequential RecommendationML 1M--
150
Sequential RecommendationSports (test)
HR@105.22
57
Sequential RecommendationBeauty (test)--
57
Sequential RecommendationYelp (test)
HR@100.0645
40
Sequential RecommendationML 1M (test)
HR@1032.8
16
Sequential RecommendationBeauty
#P@K Score937
9
Showing 6 of 6 rows

Other info

Follow for update