OpenOneRec Technical Report
About
While the OneRec series has successfully unified the fragmented recommendation pipeline into an end-to-end generative framework, a significant gap remains between recommendation systems and general intelligence. Constrained by isolated data, they operate as domain specialists-proficient in pattern matching but lacking world knowledge, reasoning capabilities, and instruction following. This limitation is further compounded by the lack of a holistic benchmark to evaluate such integrated capabilities. To address this, our contributions are: 1) RecIF Bench & Open Data: We propose RecIF-Bench, a holistic benchmark covering 8 diverse tasks that thoroughly evaluate capabilities from fundamental prediction to complex reasoning. Concurrently, we release a massive training dataset comprising 96 million interactions from 160,000 users to facilitate reproducible research. 2) Framework & Scaling: To ensure full reproducibility, we open-source our comprehensive training pipeline, encompassing data processing, co-pretraining, and post-training. Leveraging this framework, we demonstrate that recommendation capabilities can scale predictably while mitigating catastrophic forgetting of general knowledge. 3) OneRec-Foundation: We release OneRec Foundation (1.7B and 8B), a family of models establishing new state-of-the-art (SOTA) results across all tasks in RecIF-Bench. Furthermore, when transferred to the Amazon benchmark, our models surpass the strongest baselines with an average 26.8% improvement in Recall@10 across 10 diverse datasets (Figure 1). This work marks a step towards building truly intelligent recommender systems. Nonetheless, realizing this vision presents significant technical and theoretical challenges, highlighting the need for broader research engagement in this promising direction.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Sequential Recommendation | Beauty | Recall@53.75 | 24 | |
| Ad Recommendation | RecIF-Bench Ad Rec | Pass@10.0259 | 20 | |
| Label-Conditional Recommendation | RecIF-Bench Label-Cond. Rec | Pass@320.0549 | 20 | |
| Product Recommendation | RecIF-Bench Product Rec | Pass@12.23 | 20 | |
| Short Video Recommendation | RecIF-Bench Short Video Rec | Pass@15.48 | 20 | |
| Sequential Recommendation | Pet | Recall@50.0334 | 12 | |
| Sequential Recommendation | Upwork | Recall@53.98 | 12 | |
| Label Prediction | RecIF-Bench Label Pred | AUC0.6912 | 11 | |
| Interactive Recommendation | RecIF-Bench Interactive Rec | Pass@112.5 | 11 | |
| Label Prediction | RecIF-Bench | AUC0.6912 | 9 |