Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Disentangling Homophily and Heterophily in Multimodal Graph Clustering

About

Multimodal graphs, which integrate unstructured heterogeneous data with structured interconnections, offer substantial real-world utility but remain insufficiently explored in unsupervised learning. In this work, we initiate the study of multimodal graph clustering, aiming to bridge this critical gap. Through empirical analysis, we observe that real-world multimodal graphs often exhibit hybrid neighborhood patterns, combining both homophilic and heterophilic relationships. To address this challenge, we propose a novel framework -- \textsc{Disentangled Multimodal Graph Clustering (DMGC)} -- which decomposes the original hybrid graph into two complementary views: (1) a homophily-enhanced graph that captures cross-modal class consistency, and (2) heterophily-aware graphs that preserve modality-specific inter-class distinctions. We introduce a \emph{Multimodal Dual-frequency Fusion} mechanism that jointly filters these disentangled graphs through a dual-pass strategy, enabling effective multimodal integration while mitigating category confusion. Our self-supervised alignment objectives further guide the learning process without requiring labels. Extensive experiments on both multimodal and multi-relational graph datasets demonstrate that DMGC achieves state-of-the-art performance, highlighting its effectiveness and generalizability across diverse settings. Our code is available at https://github.com/Uncnbb/DMGC.

Zhaochen Guo, Zhixiang Shen, Xuanting Xie, Liangjian Wen, Zhao Kang• 2025

Related benchmarks

TaskDatasetResultRank
Node ClassificationMovies
Accuracy57.41
139
Node ClassificationGrocery
Accuracy81.55
139
Node ClassificationToys
Accuracy68.71
77
Node ClusteringRedditS
NMI89.62
50
Node ClassificationRedditS
Accuracy91.95
49
Node ClassificationREDDIT-M
Accuracy72.22
44
Link PredictionBili Dance
MRR41.37
37
Graph-to-ImageSemArt
CLIP-S Score62.15
36
Modal RetrievalEle-fashion
MRR91.34
31
Node ClusteringToys
NMI49.38
30
Showing 10 of 38 rows

Other info

Follow for update