Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Towards Deeper, Lighter and Interpretable Cross Network for CTR Prediction

About

Click Through Rate (CTR) prediction plays an essential role in recommender systems and online advertising. It is crucial to effectively model feature interactions to improve the prediction performance of CTR models. However, existing methods face three significant challenges. First, while most methods can automatically capture high-order feature interactions, their performance tends to diminish as the order of feature interactions increases. Second, existing methods lack the ability to provide convincing interpretations of the prediction results, especially for high-order feature interactions, which limits the trustworthiness of their predictions. Third, many methods suffer from the presence of redundant parameters, particularly in the embedding layer. This paper proposes a novel method called Gated Deep Cross Network (GDCN) and a Field-level Dimension Optimization (FDO) approach to address these challenges. As the core structure of GDCN, Gated Cross Network (GCN) captures explicit high-order feature interactions and dynamically filters important interactions with an information gate in each order. Additionally, we use the FDO approach to learn condensed dimensions for each field based on their importance. Comprehensive experiments on five datasets demonstrate the effectiveness, superiority and interpretability of GDCN. Moreover, we verify the effectiveness of FDO in learning various dimensions and reducing model parameters. The code is available on \url{https://github.com/anonctr/GDCN}.

Fangye Wang, Hansu Gu, Dongsheng Li, Tun Lu, Peng Zhang, Ning Gu• 2023

Related benchmarks

TaskDatasetResultRank
CTR PredictionCriteo
AUC0.8161
282
Click-Through Rate PredictionAvazu (test)
AUC0.7905
191
CTR PredictionAvazu
AUC79.09
144
CTR PredictionCriteo (test)
AUC0.8158
141
CTR PredictionFrappe
AUC0.9852
83
CTR PredictionFrappe (test)
AUC0.9838
38
CTR PredictionMalware (test)
AUC0.7456
17
CTR PredictionML-tag (test)
AUC96.45
17
CTR PredictionCriteo, Avazu, Malware, Frappe, ML-tag (averaged)
Avg AUC0.28
16
CTR PredictionML-tag
AUC0.9663
12
Showing 10 of 10 rows

Other info

Code

Follow for update