RECTOR: Masked Region-Channel-Temporal Modeling for Affective and Cognitive Representation Learning
About
Affective and cognitive disorders manifest as distributed, time-varying brain network dynamics across regions, channels, and time, challenging robust representation learning from EEG/sEEG for clinical diagnosis. We propose RECTOR (Masked Region-Channel-Temporal Modeling), an end-to-end self-supervised framework that unifies joint region-channel-temporal representation learning beyond fixed anatomical priors. At its core, RECTOR-SA is a hierarchical, block-sparse self-attention induced by Adaptive Functional Partitioning that evolves region structures from static anatomical definitions to adaptive functional regions. The self-supervision is driven by Masked Topology and Representation Learning, which jointly optimizes three complementary objectives: Masked Predictive Modeling, Topological Structure Modeling, and Cross-View Consistency. Across diverse benchmarks, RECTOR sets a new state-of-the-art in EEG emotion recognition and sEEG task-engagement classification. Crucially, its strong robustness to missing channels and cross-montage generalization underscores its potential for large-scale pre-training on heterogeneous EEG/sEEG, providing interpretable insights at both region and channel levels.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| EEG emotion recognition | SEED | -- | 74 | |
| EEG Emotion Classification | SEED IV | Cohen's Kappa45.52 | 18 | |
| EEG Emotion Classification | DEAP Valence | Cohen's Kappa0.3351 | 18 | |
| EEG Emotion Classification | DEAP Arousal | Cohen's Kappa34.34 | 18 | |
| EEG Emotion Classification | SEED (subject-dependent) | Weighted F1 Score85 | 11 | |
| EEG Emotion Classification | SEED Subject-independent | w-F161.1 | 11 | |
| EEG Emotion Classification | SEED-IV (subject-dependent) | W-F163.7 | 11 | |
| EEG Emotion Classification | SEED-IV (Subject-independent) | w-F144.8 | 11 | |
| EEG Emotion Classification | DEAP-Valence Subject Dependent | Weighted F1 Score69.4 | 11 | |
| EEG Emotion Classification | DEAP-Valence Subject Independent | Weighted F166.7 | 11 |