Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Modeling Spatiotemporal Neural Frames for High Resolution Brain Dynamic

About

Capturing dynamic spatiotemporal neural activity is essential for understanding large-scale brain mechanisms. Functional magnetic resonance imaging (fMRI) provides high-resolution cortical representations that form a strong basis for characterizing fine-grained brain activity patterns. The high acquisition cost of fMRI limits large-scale applications, therefore making high-quality fMRI reconstruction a crucial task. Electroencephalography (EEG) offers millisecond-level temporal cues that complement fMRI. Leveraging this complementarity, we present an EEG-conditioned framework for reconstructing dynamic fMRI as continuous neural sequences with high spatial fidelity and strong temporal coherence at the cortical-vertex level. To address sampling irregularities common in real fMRI acquisitions, we incorporate a null-space intermediate-frame reconstruction, enabling measurement-consistent completion of arbitrary intermediate frames and improving sequence continuity and practical applicability. Experiments on the CineBrain dataset demonstrate superior voxel-wise reconstruction quality and robust temporal consistency across whole-brain and functionally specific regions. The reconstructed fMRI also preserves essential functional information, supporting downstream visual decoding tasks. This work provides a new pathway for estimating high-resolution fMRI dynamics from EEG and advances multimodal neuroimaging toward more dynamic brain activity modeling.

Wanying Qu, Jianxiong Gao, Wei Wang, Yanwei Fu• 2026

Related benchmarks

TaskDatasetResultRank
fMRI ReconstructionCineBrain Whole Brain
MSE0.197
30
fMRI ReconstructionCineBrain Visual Cortex
MSE0.193
15
Showing 2 of 2 rows

Other info

Follow for update