Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Towards Domain Generalization for ECG and EEG Classification: Algorithms and Benchmarks

About

Despite their immense success in numerous fields, machine and deep learning systems have not yet been able to firmly establish themselves in mission-critical applications in healthcare. One of the main reasons lies in the fact that when models are presented with previously unseen, Out-of-Distribution samples, their performance deteriorates significantly. This is known as the Domain Generalization (DG) problem. Our objective in this work is to propose a benchmark for evaluating DG algorithms, in addition to introducing a novel architecture for tackling DG in biosignal classification. In this paper, we describe the Domain Generalization problem for biosignals, focusing on electrocardiograms (ECG) and electroencephalograms (EEG) and propose and implement an open-source biosignal DG evaluation benchmark. Furthermore, we adapt state-of-the-art DG algorithms from computer vision to the problem of 1D biosignal classification and evaluate their effectiveness. Finally, we also introduce a novel neural network architecture that leverages multi-layer representations for improved model generalizability. By implementing the above DG setup we are able to experimentally demonstrate the presence of the DG problem in ECG and EEG datasets. In addition, our proposed model demonstrates improved effectiveness compared to the baseline algorithms, exceeding the state-of-the-art in both datasets. Recognizing the significance of the distribution shift present in biosignal datasets, the presented benchmark aims at urging further research into the field of biomedical DG by simplifying the evaluation process of proposed algorithms. To our knowledge, this is the first attempt at developing an open-source framework for evaluating ECG and EEG DG algorithms.

Aristotelis Ballas, Christos Diou• 2023

Related benchmarks

TaskDatasetResultRank
ECG ClassificationPTB-XL (test)
AUC66
46
ECG ClassificationCPSC 2018 (test)
AUROC67
12
ECG ClassificationChapman Intra-Source protocol (test)
Accuracy99
4
ECG ClassificationCPSC Intra-Source protocol 2018 (test)
Accuracy74
4
ECG ClassificationGeorgia Intra-Source protocol (test)
Accuracy69
4
ECG ClassificationPTB-XL Intra-Source protocol (test)
Accuracy84
4
ECG ClassificationGeorgia (test)
Accuracy84
3
ECG ClassificationChapman (test)
Accuracy69
3
Showing 8 of 8 rows

Other info

Follow for update