Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

LGMRec: Local and Global Graph Learning for Multimodal Recommendation

About

The multimodal recommendation has gradually become the infrastructure of online media platforms, enabling them to provide personalized service to users through a joint modeling of user historical behaviors (e.g., purchases, clicks) and item various modalities (e.g., visual and textual). The majority of existing studies typically focus on utilizing modal features or modal-related graph structure to learn user local interests. Nevertheless, these approaches encounter two limitations: (1) Shared updates of user ID embeddings result in the consequential coupling between collaboration and multimodal signals; (2) Lack of exploration into robust global user interests to alleviate the sparse interaction problems faced by local interest modeling. To address these issues, we propose a novel Local and Global Graph Learning-guided Multimodal Recommender (LGMRec), which jointly models local and global user interests. Specifically, we present a local graph embedding module to independently learn collaborative-related and modality-related embeddings of users and items with local topological relations. Moreover, a global hypergraph embedding module is designed to capture global user and item embeddings by modeling insightful global dependency relations. The global embeddings acquired within the hypergraph embedding space can then be combined with two decoupled local embeddings to improve the accuracy and robustness of recommendations. Extensive experiments conducted on three benchmark datasets demonstrate the superiority of our LGMRec over various state-of-the-art recommendation baselines, showcasing its effectiveness in modeling both local and global user interests.

Zhiqiang Guo, Jianjun Li, Guohui Li, Chaoyang Wang, Si Shi, Bin Ruan• 2023

Related benchmarks

TaskDatasetResultRank
RecommendationAmazon Sports (test)
Recall@104.55
57
RecommendationAmazon Baby (test)
Recall@100.0412
42
RecommendationBeauty
Recall@1010.72
39
Multimodal RecommendationAmazon Baby (test)
Recall@106.44
39
Multimodal RecommendationSports Amazon (test)
Recall@107.2
39
RecommendationOFFICE--
31
RecommendationSports
Recall@100.0719
26
Multimodal RecommendationAmazon Clothing (test)
Recall@105.55
25
RecommendationClothing
Recall@105.55
22
RecommendationToys
Hit Ratio@100.1005
21
Showing 10 of 20 rows

Other info

Follow for update