Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DIVER-1: Scaling Intracranial EEG Foundation Models for Transferable Representations

About

Intracranial EEG (iEEG) provides direct, millisecond-scale recordings of human neural activity, but reusable representation learning is difficult because electrode layouts, anatomical coverage, referencing schemes, and recording conditions vary across patients and centers. We introduce DIVER-1, a self-supervised iEEG foundation model for variable-input recordings that combines any-variate electrode-time attention, spatio-temporal resampling, input-conditioned positional embeddings, and multi-domain masked reconstruction without assuming a fixed electrode montage. We pretrain two variants, DIVER-1-0.1s and DIVER-1-1s, on 5,310 hours of ECoG and SEEG spanning 352k channel-hours, roughly 54x the BrainTreeBank-based pretraining volume. We evaluate DIVER-1 on two held-out benchmarks: Neuroprobe for naturalistic cognitive decoding and MAYO for seizure detection. On leakage-aware Neuroprobe, DIVER-1-0.1s outperforms prior evaluated iEEG foundation models despite using no BrainTreeBank recordings, the corpus underlying Neuroprobe, during pretraining; it also exceeds the linear spectrogram decoder in mean AUROC and remains competitive with stronger nonlinear baselines, a level prior evaluated iEEG foundation models did not reach. DIVER-1-1s also achieves the top AUROC on MAYO seizure detection. Finally, we conduct, to our knowledge, the first controlled compute-aware scaling study for self-supervised iEEG pretraining, sweeping data scale, subject count, training duration, and model size up to 1.8B parameters. Our results indicate a data-constrained regime: expanding unique recordings and training sufficiently long are more reliable scaling axes than increasing parameter count alone. Code is available at link.

Danny Dongyeop Han, Yonghyeon Gwon, Ahhyun Lucy Lee, Taeyang Lee, Seong Jin Lee, Jubin Choi, Sebin Lee, Jihyun Bang, Seungju Lee, David Keetae Park, Shinjae Yoo, Chun Kee Chung, Jiook Cha• 2025

Related benchmarks

TaskDatasetResultRank
Emotion RecognitionFACED 9-class original
Accuracy60.1
11
iEEG neural decodingNeuroprobe binary-label 1s (overall)
AUROC0.676
5
iEEG neural decodingMAYO 6s
AUROC0.961
5
Neural signal decodingNeuroprobe iEEG
Overall AUROC0.676
5
iEEG neural decodingNeuroprobe multi-label 1s (overall)
AUROC63.1
3
Mental Arithmetic ClassificationMentalArithmetic 2-class original
Accuracy72.7
3
Motor Imagery ClassificationPhysioNet-MI 4-class original
Accuracy67.6
3
Showing 7 of 7 rows

Other info

Follow for update