Beyond Isolated Clients: Integrating Graph-Based Embeddings into Event Sequence Models
About
Large-scale digital platforms generate billions of timestamped user-item interactions (events) that are crucial for predicting user attributes in, e.g., fraud prevention and recommendations. While self-supervised learning (SSL) effectively models the temporal order of events, it typically overlooks the global structure of the user-item interaction graph. To bridge this gap, we propose three model-agnostic strategies for integrating this structural information into contrastive SSL: enriching event embeddings, aligning client representations with graph embeddings, and adding a structural pretext task. Experiments on four financial and e-commerce datasets demonstrate that our approach consistently improves the accuracy (up to a 2.3% AUC) and reveals that graph density is a key factor in selecting the optimal integration strategy.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Binary Classification | Gender 2019 (test) | AUC0.889 | 12 | |
| Classification | Internal Bank Data (test) | AUC0.91 | 12 | |
| Multi-class classification | Age sberbank-sirius-lesson (test) | Accuracy64 | 12 | |
| Age Prediction | MTS-ML-Cup | Accuracy A39.1 | 4 | |
| Gender Prediction | MTS-ML-Cup | Accuracy (Gender)59 | 4 |