OneReason Technical Report
About
Generative recommendation models in the OneRec family have been widely deployed in many real-world services, such as short-video, live-streaming, advertising, and e-commerce. However, these generative models can only benefit from the scaling advantage, while their reasoning ability is hard to activate, since we cannot construct meaningful Chain-of-Thought (CoT) sequences consisting of itemic tokens only. Inspired by the success of the reasoning-style ``think before answer'' paradigm in the LLM field, we conduct preliminary studies (i.e., OneRec-Think, OpenOneRec) to explore reasoning capability in generative recommendation. Nevertheless, we notice an unexpected phenomenon: the thinking mode does not show advantages over the non-thinking mode. Drawing insights from recent findings on CoT robustness in multi-modal language models, we argue that effective reasoning in recommendation rests on two factors: perception, the ability to ground itemic tokens in their underlying language semantics, and cognition, the ability to reorganize a user's behavior sequence into coherent latent interest points. We therefore propose OneReason, which includes: (1) strong itemic token perception in pre-training, (2) a three-level cognition-enhanced CoT format for recommendation tasks in SFT, and (3) a specialize-then-unify training recipe in RL to enhance the thinking ability.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Cross-domain Recommendation | Cross-Video | Pass@642.41 | 18 | |
| Cross-domain Recommendation | Cross-Product | Pass@645.47 | 18 | |
| Cross-domain Recommendation | Cross-Ad | Pass@6417.78 | 18 | |
| Cross-domain Recommendation | Cross-Live | Pass@6421.1 | 18 | |
| Evolution | OneReason-Bench | Selection Score42.42 | 13 | |
| Derivation | OneReason-Bench | I2I Score28.6 | 7 | |
| Perception | OneReason-Bench | Item Understanding36.91 | 7 | |
| Advertising Recommendation | Kuaishou Advertising Online A/B (test) | Exposure Change10.332 | 5 |