Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SYNAPSE: Neuro-Symbolic Visual Thought-to-Text Decoding via Topological Semantic Denoising

About

Recent advances in large language models have accelerated open-vocabulary EEG-to-imagined-text decoding, where non-invasive neural activity recorded during visual perception is translated into coherent natural language descriptions of viewed stimuli. However, existing systems remain highly vulnerable to biological noise, where corrupted neural projections induce hallucinated or semantically unstable generation in frozen language models. We introduce SYNAPSE (Symbolic Neural Alignment for Precise Semantic Extraction), a lightweight neuro-symbolic framework that stabilizes neural text generation through inference-time symbolic regularization. By purifying EEG-derived semantic candidates using commonsense graph structure and latent exemplars, SYNAPSE improves semantic stability without end-to-end LLM fine-tuning. Experiments across popular EEG decoding benchmarks and multiple frozen LLM backends demonstrate consistent gains over unconstrained prompting baselines, robustness under object-label ablation, and performance commensurate with substantially more resource-intensive fine-tuned systems, while preserving biometric privacy by localizing raw EEG processing entirely within the encoder stack.

Akshaj Murhekar, Abhijit Mishra• 2026

Related benchmarks

TaskDatasetResultRank
EEG-to-text translationEEG-ImageNet CVPR2017 (test)
ROUGE-132.7
64
EEG-to-Text DecodingTHINGS EEG cross-exemplar evaluation suite v2
ROUGE-121.8
12
Showing 2 of 2 rows

Other info

Follow for update