Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ECG-FM: An Open Electrocardiogram Foundation Model

About

Conventional task-specific electrocardiogram (ECG) analysis models require large annotated datasets to train. Foundation models mitigate this burden by leveraging self-supervised pretraining; however, the scarcity of open-weight ECG foundation models hinders adoption and cross-study comparability. We present ECG-FM, an open foundation model for ECG analysis, and conduct a study using a dataset of 1.5 million ECGs. ECG-FM is a transformer-based model pretrained using a hybrid contrastive and generative self-supervised learning approach. Our downstream tasks include predicting reduced left ventricular ejection fraction (LVEF) and ECG interpretation labels, where we release a benchmark task on the MIMIC-IV-ECG dataset. We affirm that ECG-FM is robust, label-efficient, and functionally discriminative by showcasing data scaling experiments, performing a latent space analysis, and generating saliency maps. ECG-FM markedly outperforms task-specific models in the small-to-medium-scale data regime and demonstrates cross-dataset generalizability, achieving high AUROC on many clinically salient labels such as atrial fibrillation (0.996) and LVEF<=40% (0.929). We release our code, model weights, and benchmark task at https://github.com/bowang-lab/ECG-FM/.

Kaden McKeen, Sameer Masood, Augustin Toma, Barry Rubin, Bo Wang• 2024

Related benchmarks

TaskDatasetResultRank
LVEF < 40% predictionMIMIC All (test)
Balanced Accuracy70.7
13
ECHO-related classificationMUSIC (test)
LVEF < 40% Classification64.8
12
LVEF < 40% predictionMIMIC Low Uncertainty (test)
Balanced Accuracy72.4
11
LVEF < 40% predictionMIMIC High Uncertainty (test)
Balanced Accuracy69
11
Age EstimationECG (test)
MAE13.49
6
AD ClassificationECG (test)
Accuracy49
6
Ka ClassificationECG (test)
F1 Score0.49
6
RR Interval EstimationECG (test)
MAE (ms)147.3
6
Sex ClassificationECG (test)
F1 Score0.52
6
Showing 9 of 9 rows

Other info

Follow for update