PanLUNA: An Efficient and Robust Query-Unified Multimodal Model for Edge Biosignal Intelligence
About
Physiological foundation models (FMs) have shown promise for biosignal representation learning, yet most remain confined to a single modality such as EEG, ECG, or PPG, largely because paired multimodal datasets are scarce. In this paper, we present PanLUNA, a compact 5.4M-parameter pan-modal FM that jointly processes EEG, ECG, and PPG within a single shared encoder. Extending LUNA's channel-unification module, PanLUNA treats multimodal channels as entries in a unified query set augmented with sensor-type embeddings, enabling efficient cross-modal early fusion while remaining inherently robust to missing modalities at inference time. Despite its small footprint, PanLUNA matches or exceeds models up to 57$\times$ larger: 81.21% balanced accuracy on TUAB abnormal EEG detection and state-of-the-art 0.7416 balanced accuracy on HMC multimodal sleep staging. Quantization-aware training with INT8 weights recovers $\geq$96% of full-precision performance, and deployment on the GAP9 ultra-low-power RISC-V microcontroller for wearables achieves 325.6 ms latency and 18.8 mJ per 10-second, 12-lead ECG inference, and 1.206 s latency at 68.65 mJ for multimodal 5-channel sleep staging over 30-second epochs.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Binary classification of normal versus abnormal EEG signals | TUAB | Balanced Accuracy81.21 | 49 | |
| sleep stages classification | HMC | Balanced Accuracy0.7416 | 18 | |
| Biosignal Inference | ECG 12-channel | Latency (ms)3.26e+5 | 2 | |
| Sleep Staging | HMC EEG+ECG 5-channel | Cycles (M)4.46e+8 | 1 | |
| Biosignal Inference | ECG 1-channel | -- | 1 | |
| Biosignal Inference | EMG | -- | 1 | |
| Biosignal Inference | EEG 22-channel | -- | 1 |