Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Progressively Modality Freezing for Multi-Modal Entity Alignment

About

Multi-Modal Entity Alignment aims to discover identical entities across heterogeneous knowledge graphs. While recent studies have delved into fusion paradigms to represent entities holistically, the elimination of features irrelevant to alignment and modal inconsistencies is overlooked, which are caused by inherent differences in multi-modal features. To address these challenges, we propose a novel strategy of progressive modality freezing, called PMF, that focuses on alignmentrelevant features and enhances multi-modal feature fusion. Notably, our approach introduces a pioneering cross-modal association loss to foster modal consistency. Empirical evaluations across nine datasets confirm PMF's superiority, demonstrating stateof-the-art performance and the rationale for freezing modalities. Our code is available at https://github.com/ninibymilk/PMF-MMEA.

Yani Huang, Xuefeng Zhang, Richong Zhang, Junfan Chen, Jaein Kim• 2024

Related benchmarks

TaskDatasetResultRank
Entity AlignmentDBP15K FR-EN
Hits@10.879
158
Entity AlignmentDBP15K ZH-EN
H@186.7
143
Entity AlignmentDBP15K JA-EN
Hits@10.866
126
Entity AlignmentMMKG FBDB15K
H@162.4
13
Entity AlignmentMMKG FBYG15K
H@154.3
13
Entity AlignmentMulti-OpenEA EN-FR V1
H@192.3
13
Entity AlignmentMulti-OpenEA EN-DE V1
H@198
13
Entity AlignmentMulti-OpenEA D-W V1
H@196
13
Entity AlignmentMulti-OpenEA D-W V2
H@198.6
13
Showing 9 of 9 rows

Other info

Code

Follow for update