Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GraphHash: Graph Clustering Enables Parameter Efficiency in Recommender Systems

About

Deep recommender systems rely heavily on large embedding tables to handle high-cardinality categorical features such as user/item identifiers, and face significant memory constraints at scale. To tackle this challenge, hashing techniques are often employed to map multiple entities to the same embedding and thus reduce the size of the embedding tables. Concurrently, graph-based collaborative signals have emerged as powerful tools in recommender systems, yet their potential for optimizing embedding table reduction remains unexplored. This paper introduces GraphHash, the first graph-based approach that leverages modularity-based bipartite graph clustering on user-item interaction graphs to reduce embedding table sizes. We demonstrate that the modularity objective has a theoretical connection to message-passing, which provides a foundation for our method. By employing fast clustering algorithms, GraphHash serves as a computationally efficient proxy for message-passing during preprocessing and a plug-and-play graph-based alternative to traditional ID hashing. Extensive experiments show that GraphHash substantially outperforms diverse hashing baselines on both retrieval and click-through-rate prediction tasks. In particular, GraphHash achieves on average a 101.52% improvement in recall when reducing the embedding table size by more than 75%, highlighting the value of graph-based collaborative information for model reduction. Our code is available at https://github.com/snap-research/GraphHash.

Xinyi Wu, Donald Loveland, Runjin Chen, Yozen Liu, Xin Chen, Leonardo Neves, Ali Jadbabaie, Clark Mingxuan Ju, Neil Shah, Tong Zhao• 2024

Related benchmarks

TaskDatasetResultRank
RecommendationYelp 2018
Recall@206.244
73
RecommendationGowalla
Recall @ 2015.325
35
RecommendationBeauty
Recall@105.776
20
RecommendationGowalla
Recall@1010.672
20
RecommendationYelp 2018
Recall@103.863
20
RecommendationBeauty
Recall@208.167
20
RecommendationAmazonBook
Recall@105.081
19
RecommendationAmazonBook
Recall@207.261
19
RecommendationMovieLens
Recall@2020.631
16
RecommendationSteamGame
Recall@206.354
4
Showing 10 of 10 rows

Other info

Follow for update