Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Neuroscience-inspired Staged Representation Learning with Disentangled Coarse- and Fine-Grained Semantics for EEG Visual Decoding

About

Decoding visual information from electroencephalography (EEG) signals remains a fundamental challenge in brain-computer interfaces and medical rehabilitation. Existing EEG visual decoding methods mainly focus on learning a single global EEG embedding for cross-modal alignment, but they largely overlook the staged and hierarchical characteristics of human visual processing. To address this limitation, we propose a neuroscience-inspired staged representation learning framework that reformulates EEG visual decoding as a stage-specific representation decomposition problem. The proposed framework organizes EEG representation learning into three complementary phases: low-level visual representation learning, high-level semantic representation learning, and integrative information fusion. To strengthen semantic modeling, we further introduce a multimodal dual-level semantic learning mechanism that separates coarse label-level semantics from fine image-level visual-semantic information. In addition, semantic latent channels are introduced as computational representation channels generated from observed visual EEG signals, expanding the channel-level semantic representation space for structured semantic abstraction and cross-modal alignment. Extensive experiments on the THINGS-EEG benchmark demonstrate that the proposed method achieves superior performance under subject-dependent zero-shot evaluation and improved exact retrieval under subject-independent zero-shot evaluation. Additional analyses, including layer-wise retrieval, temporal accumulation, expanded multi-image retrieval, and ablation studies, further support the effectiveness of staged decomposition and structured semantic modeling. These results suggest that explicitly modeling staged perceptual, semantic, and integrative representations provides an effective neuroscience-inspired framework for EEG-based visual decoding.

Xiang Gao, Hui Tian, Yanming Zhu, Xuefei Yin, Alan Wee-Chung Liew• 2026

Related benchmarks

TaskDatasetResultRank
ClassificationTHINGS-EEG Subject-dependent 200-way zero-shot (test)
Top-1 Accuracy (Sub01)48.5
10
200-way zero-shot classificationTHINGS-EEG Average across 10 subjects
Top-1 Accuracy13.2
6
200-way zero-shot classificationTHINGS-EEG Sub01
Top-1 Accuracy13
5
200-way zero-shot classificationTHINGS-EEG Sub02
Top-1 Accuracy (Zero-shot)16.5
5
200-way zero-shot classificationTHINGS-EEG Sub05
Top-1 Accuracy (zero-shot)10
5
200-way zero-shot classificationTHINGS-EEG Sub06
Top-1 Accuracy (zero-shot)14
5
200-way zero-shot classificationTHINGS-EEG Sub04
Top-1 Accuracy14.5
5
200-way zero-shot classificationTHINGS-EEG Sub09
Top-1 Accuracy (Zero-Shot)14.5
5
200-way zero-shot classificationTHINGS-EEG Sub10
Top-1 Accuracy (zero-shot)20.5
5
200-way zero-shot classificationTHINGS-EEG Sub03
Top-1 Accuracy8
5
Showing 10 of 12 rows

Other info

Follow for update