Multi-Level Bidirectional Biomimetic Learning for EEG-Based Visual Decoding
About
EEG-based visual neural decoding aims to align neural responses with visual stimuli for tasks such as image retrieval. However, limited paired data and a fundamental mismatch between high-fidelity digital images and biological visual perception - distorted by retinotopic mapping and subject-specific neuroanatomy - severely impede cross-modal alignment. To address this, we propose MB2L, a Multi-Level Bidirectional Biomimetic Learning framework that incorporates structured physiological inductive biases into representation learning. Specifically, we propose Adaptive Blur with Visual Priors to mitigate perceptual-structural mismatch by reweighting visual inputs according to retinotopic priors. We further propose Biomimetic Visual Feature Extraction to learn multi-level visual representations consistent with hierarchical cortical processing, enhancing subject-invariant encoding. These modules are jointly optimized via Multi-level Bidirectional Contrastive Learning, which aligns EEG and visual features in a shared semantic space through bidirectional contrastive objectives. Experiments show MB2L achieves 80.5% Top-1 and 97.6% Top-5 accuracy on zero-shot EEG-to-image retrieval, significantly outperforming prior methods and demonstrating strong generalization across subjects and experimental settings.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Retrieval | THINGS-EEG 200-way zero-shot retrieval (Intra-Subject) | Top-5 Accuracy99.5 | 125 | |
| Retrieval | THINGS-EEG 200-way zero-shot retrieval (Inter-Subject) | Top-1 Acc30 | 88 | |
| 200-way retrieval | THINGS-MEG Intra-subject | Top-1 Accuracy36.1 | 33 | |
| 200-way Zero-shot Retrieval | THINGS-MEG Inter-subject | Top-1 Accuracy (Avg)5.3 | 12 |