Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PanLUNA: An Efficient and Robust Query-Unified Multimodal Model for Edge Biosignal Intelligence

About

Physiological foundation models (FMs) have shown promise for biosignal representation learning, yet most remain confined to a single modality such as EEG, ECG, or PPG, largely because paired multimodal datasets are scarce. In this paper, we present PanLUNA, a compact 5.4M-parameter pan-modal FM that jointly processes EEG, ECG, and PPG within a single shared encoder. Extending LUNA's channel-unification module, PanLUNA treats multimodal channels as entries in a unified query set augmented with sensor-type embeddings, enabling efficient cross-modal early fusion while remaining inherently robust to missing modalities at inference time. Despite its small footprint, PanLUNA matches or exceeds models up to 57$\times$ larger: 81.21% balanced accuracy on TUAB abnormal EEG detection and state-of-the-art 0.7416 balanced accuracy on HMC multimodal sleep staging. Quantization-aware training with INT8 weights recovers $\geq$96% of full-precision performance, and deployment on the GAP9 ultra-low-power RISC-V microcontroller for wearables achieves 325.6 ms latency and 18.8 mJ per 10-second, 12-lead ECG inference, and 1.206 s latency at 68.65 mJ for multimodal 5-channel sleep staging over 30-second epochs.

Marija Zelic, Anna Tegon, Yawei Li, Thorir Mar Ingolfsson, Luca Benini• 2026

Related benchmarks

TaskDatasetResultRank
Binary classification of normal versus abnormal EEG signalsTUAB
Balanced Accuracy81.21
49
sleep stages classificationHMC
Balanced Accuracy0.7416
18
Biosignal InferenceECG 12-channel
Latency (ms)3.26e+5
2
Sleep StagingHMC EEG+ECG 5-channel
Cycles (M)4.46e+8
1
Biosignal InferenceECG 1-channel--
1
Biosignal InferenceEMG--
1
Biosignal InferenceEEG 22-channel--
1
Showing 7 of 7 rows

Other info

Follow for update