Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Unbiased Multimodal Reranking for Long-Tail Short-Video Search

About

Kuaishou serving hundreds of millions of searches daily, the quality of short-video search is paramount. However, it suffers from a severe Matthew effect on long-tail queries: sparse user behavior data causes models to amplify low-quality content such as clickbait and shallow content. The recent advancements in Large Language Models (LLMs) offer a new paradigm, as their inherent world knowledge provides a powerful mechanism to assess content quality, agnostic to sparse user interactions. To this end, we propose a LLM-driven multimodal reranking framework, which estimates user experience without real user behavior. The approach involves a two-stage training process: the first stage uses multimodal evidence to construct high-quality annotations for supervised fine-tuning, while the second stage incorporates pairwise preference optimization to help the model learn partial orderings among candidates. At inference time, the resulting experience scores are used to promote high-quality but underexposed videos in reranking, and further guide page-level optimization through reinforcement learning. Experiments show that the proposed method achieves consistent improvements over strong baselines in offline metrics including AUC, NDCG@K, and human preference judgement. An online A/B test covering 15\% of traffic further demonstrates gains in both user experience and consumption metrics, confirming the practical value of the approach in long-tail video search scenarios.

Wenyi Xu, Feiran Zhu, Songyang Li, Renzhe Zhou, Chao Zhang, Chenglei Dai, Yuren Mao, Yunjun Gao, Yi Zhang• 2026

Related benchmarks

TaskDatasetResultRank
RankingHuman-labeled query set
NDCG@10.849
6
Human Preference EvaluationKuaishou search long-tail query segment (test)
Good Count48
2
Search rerankingKuaishou Search (all queries)
IQRR-0.11
1
Search rerankingKuaishou Search (long-tail queries)
IQRR-1.28
1
Showing 4 of 4 rows

Other info

Follow for update