Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SleepLM: Natural-Language Intelligence for Human Sleep

About

We present SleepLM, a family of sleep-language foundation models that enable human sleep alignment, interpretation, and interaction with natural language. Despite the critical role of sleep, learning-based sleep analysis systems operate in closed label spaces (e.g., predefined stages or events) and fail to describe, query, or generalize to novel sleep phenomena. SleepLM bridges natural language and multimodal polysomnography, enabling language-grounded representations of sleep physiology. To support this alignment, we introduce a multilevel sleep caption generation pipeline that enables the curation of the first large-scale sleep-text dataset, comprising over 100K hours of data from more than 10,000 individuals. Furthermore, we present a unified pretraining objective that combines contrastive alignment, caption generation, and signal reconstruction to better capture physiological fidelity and cross-modal interactions. Extensive experiments on real-world sleep understanding tasks verify that SleepLM outperforms state-of-the-art in zero-shot and few-shot learning, cross-modal retrieval, and sleep captioning. Importantly, SleepLM also exhibits intriguing capabilities including language-guided event localization, targeted insight generation, and zero-shot generalization to unseen tasks. All code and data will be open-sourced.

Zongzhe Xu, Zitao Shuai, Eideen Mozaffari, Ravi S. Aysola, Rajesh Kumar, Yuzhe Yang• 2026

Related benchmarks

TaskDatasetResultRank
Oxygen Desaturation ClassificationCFS (test)
AUROC65.2
25
Sleep Stage ClassificationCFS (test)
AUROC88.3
25
Sleep Stage ClassificationCFS unseen (test)
AUC87.2
15
Arousal DetectionCFS unseen (test)
AUC89.2
9
Oxygen Desaturation DetectionCFS unseen (test)
AUC84.1
9
Hypopnea DetectionCFS (test)
AUC0.751
6
Heart Rate RegressionSHHS, MrOS, and CFS average (test)
MAE1.97
5
Sleep Event DetectionSHHS, MrOS, and CFS average (test)
IoU30.4
5
Sleep Stage ClassificationSHHS, MrOS, and CFS average (test)
AUC85.4
5
SpO2 RegressionSHHS, MrOS, and CFS average (test)
MAE2.24
5
Showing 10 of 19 rows

Other info

Follow for update