Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Trusted Unified Feature-Neighborhood Dynamics for Multi-View Classification

About

Multi-view classification (MVC) faces inherent challenges due to domain gaps and inconsistencies across different views, often resulting in uncertainties during the fusion process. While Evidential Deep Learning (EDL) has been effective in addressing view uncertainty, existing methods predominantly rely on the Dempster-Shafer combination rule, which is sensitive to conflicting evidence and often neglects the critical role of neighborhood structures within multi-view data. To address these limitations, we propose a Trusted Unified Feature-NEighborhood Dynamics (TUNED) model for robust MVC. This method effectively integrates local and global feature-neighborhood (F-N) structures for robust decision-making. Specifically, we begin by extracting local F-N structures within each view. To further mitigate potential uncertainties and conflicts in multi-view fusion, we employ a selective Markov random field that adaptively manages cross-view neighborhood dependencies. Additionally, we employ a shared parameterized evidence extractor that learns global consensus conditioned on local F-N structures, thereby enhancing the global integration of multi-view features. Experiments on benchmark datasets show that our method improves accuracy and robustness over existing approaches, particularly in scenarios with high uncertainty and conflicting views. The code will be made available at https://github.com/JethroJames/TUNED.

Haojian Huang, Chuanyu Qin, Zhe Liu, Kaijing Ma, Jin Chen, Han Fang, Chao Ban, Hao Sun, Zhongjiang He• 2024

Related benchmarks

TaskDatasetResultRank
Multi-view ClassificationBBC
Accuracy96.93
16
Multi-view ClassificationUCI
Accuracy98.9
16
Multi-view ClassificationCUB
Accuracy94.67
16
Multi-view ClassificationMSRC V1
Accuracy99.05
16
Multi-view ClassificationCaltech-6V
Accuracy95.15
16
Multi-view ClassificationCaltech
Accuracy99.59
16
Multi-view ClassificationScene
Accuracy78.15
16
Multi-view ClassificationLandUse
Accuracy72.95
16
Multi-view ClassificationNUS
Accuracy43.35
16
Multi-view ClassificationLeaves
Accuracy94.25
16
Showing 10 of 19 rows

Other info

Follow for update