Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LUNA: Efficient and Topology-Agnostic Foundation Model for EEG Signal Analysis

About

Electroencephalography (EEG) offers a non-invasive lens into human brain activity, but building large-scale models is hampered by topological heterogeneity: each public EEG data defines its own electrode layout, limiting generalization. We introduce LUNA (Latent Unified Network Architecture), a self-supervised foundation model that reconciles disparate electrode geometries while scaling linearly -- not quadratically -- with channel count. LUNA compresses multi-channel EEG into a fixed-size, topology-agnostic latent space via learned queries and cross-attention. Downstream transformer blocks then operate exclusively on this latent representation using patch-wise temporal self-attention, decoupling computation from electrode count. Pre-trained on TUEG and Siena (over 21,000 hours of raw EEG across diverse montages) using a masked-patch reconstruction objective, LUNA transfers effectively to four downstream tasks: abnormality detection, artifact rejection, slowing classification, and emotion recognition. It demonstrates highly competitive performance across several benchmarks, achieving state-of-the-art results on TUAR and TUSL, e.g., 0.921 AUROC on TUAR, while reducing FLOPs by 300x and trimming GPU memory use by up to 10x. Critically, these gains are consistent across all evaluated electrode configurations. Code is available at https://github.com/pulp-bio/BioFoundation

Berkay D\"oner, Thorir Mar Ingolfsson, Luca Benini, Yawei Li• 2025

Related benchmarks

TaskDatasetResultRank
Binary classification of normal versus abnormal EEG signalsTUAB
Balanced Accuracy81.57
49
Normal/Abnormal ClassificationTUAB (official)
AUROC88.68
8
EEG ClassificationEEG-Bench
5-Finger MI Accuracy19.4
8
EEG Event ClassificationTUSL
AUROC76.7
4
EEG Artifact DetectionTUAR
AUROC90.2
4
EEG ClassificationEEG-Bench Clinical tasks
Abnormal Classification Accuracy75.9
4
Motor Imagery ClassificationEEG-Bench standardized (test)
5-Finger MI Acc19.6
4
Showing 7 of 7 rows

Other info

Follow for update