Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Prediction

About

Click-through rate (CTR) prediction is an essential task in web applications such as online advertising and recommender systems, whose features are usually in multi-field form. The key of this task is to model feature interactions among different feature fields. Recently proposed deep learning based models follow a general paradigm: raw sparse input multi-filed features are first mapped into dense field embedding vectors, and then simply concatenated together to feed into deep neural networks (DNN) or other specifically designed networks to learn high-order feature interactions. However, the simple \emph{unstructured combination} of feature fields will inevitably limit the capability to model sophisticated interactions among different fields in a sufficiently flexible and explicit fashion. In this work, we propose to represent the multi-field features in a graph structure intuitively, where each node corresponds to a feature field and different fields can interact through edges. The task of modeling feature interactions can be thus converted to modeling node interactions on the corresponding graph. To this end, we design a novel model Feature Interaction Graph Neural Networks (Fi-GNN). Taking advantage of the strong representative power of graphs, our proposed model can not only model sophisticated feature interactions in a flexible and explicit fashion, but also provide good model explanations for CTR prediction. Experimental results on two real-world datasets show its superiority over the state-of-the-arts.

Zekun Li, Zeyu Cui, Shu Wu, Xiaoyu Zhang, Liang Wang• 2019

Related benchmarks

TaskDatasetResultRank
CTR PredictionCriteo
AUC0.8135
282
Click-Through Rate PredictionAvazu (test)
AUC0.7892
191
CTR PredictionAvazu
AUC79.156
144
CTR PredictionCriteo (test)
AUC0.8133
141
CTR PredictionMovieLens
AUC88.99
55
CTR PredictionFrappe (test)
AUC0.9648
38
CTR PredictionMovieLens (test)
Logloss0.2563
21
CTR PredictionAvazu, Criteo, MovieLens, Frappe Average
Avg Rel LogLoss Imp15.66
20
CTR PredictionAmazon-Fashion
AUC0.7445
16
CTR PredictionAmazon Instrument
AUC0.7146
16
Showing 10 of 10 rows

Other info

Code

Follow for update