Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

TF4CTR: Twin Focus Framework for CTR Prediction via Adaptive Sample Differentiation

About

Effective feature interaction modeling is critical for enhancing the accuracy of click-through rate (CTR) prediction in industrial recommender systems. Most of the current deep CTR models resort to building complex network architectures to better capture intricate feature interactions or user behaviors. However, we identify two limitations in these models: (1) the samples given to the model are undifferentiated, which may lead the model to learn a larger number of easy samples in a single-minded manner while ignoring a smaller number of hard samples, thus reducing the model's generalization ability; (2) differentiated feature interaction encoders are designed to capture different interactions information but receive consistent supervision signals, thereby limiting the effectiveness of the encoder. To bridge the identified gaps, this paper introduces a novel CTR prediction framework by integrating the plug-and-play Twin Focus (TF) Loss, Sample Selection Embedding Module (SSEM), and Dynamic Fusion Module (DFM), named the Twin Focus Framework for CTR (TF4CTR). Specifically, the framework employs the SSEM at the bottom of the model to differentiate between samples, thereby assigning a more suitable encoder for each sample. Meanwhile, the TF Loss provides tailored supervision signals to both simple and complex encoders. Moreover, the DFM dynamically fuses the feature interaction information captured by the encoders, resulting in more accurate predictions. Experiments on five real-world datasets confirm the effectiveness and compatibility of the framework, demonstrating its capacity to enhance various representative baselines in a model-agnostic manner. To facilitate reproducible research, our open-sourced code and detailed running logs will be made available at: https://github.com/salmon1802/TF4CTR.

Honghao Li, Yiwen Zhang, Yi Zhang, Lei Sang, Yun Yang• 2024

Related benchmarks

TaskDatasetResultRank
CTR PredictionCriteo
AUC0.815
282
CTR PredictionFrappe
AUC0.9872
83
Click-Through Rate PredictionKKBOX
AUC84.5
48
CTR PredictionML 1M
AUC0.8194
11
CTR PredictionML-tag
AUC (%)97.46
11
CTR PredictionKKBox first epoch (train)
Training Time30
7
CTR PredictionKKBox (val)
Inference Latency0.21
7
Showing 7 of 7 rows

Other info

Code

Follow for update