Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

HiMAE: Hierarchical Masked Autoencoders Discover Resolution-Specific Structure in Wearable Time Series

About

Wearable sensors provide abundant physiological time series, yet the principles governing their predictive utility remain unclear. We hypothesize that temporal resolution is a fundamental axis of representation learning, with different clinical and behavioral outcomes relying on structure at distinct scales. To test this resolution hypothesis, we introduce HiMAE (Hierarchical Masked Autoencoder), a self supervised framework that combines masked autoencoding with a hierarchical convolutional encoder decoder. HiMAE produces multi resolution embeddings that enable systematic evaluation of which temporal scales carry predictive signal, transforming resolution from a hyperparameter into a probe for interpretability. Across classification, regression, and generative benchmarks, HiMAE consistently outperforms state of the art foundation models that collapse scale, while being orders of magnitude smaller. HiMAE is an efficient representation learner compact enough to run entirely on watch, achieving sub millisecond inference on smartwatch class CPUs for true edge inference. Together, these contributions position HiMAE as both an efficient self supervised learning method and a discovery tool for scale sensitive structure in wearable health.

Simon A. Lee, Cyrus Tanade, Hao Zhou, Juhyeon Lee, Megha Thukral, Minji Han, Rachel Choi, Md Sazzad Hissain Khan, Baiying Lu, Migyeong Gwak, Mehrab Bin Morshed, Viswam Nathan, Md Mahbubur Rahman, Li Zhu, Subramaniam Venkatraman, Sharanya Arcot Desai• 2025

Related benchmarks

TaskDatasetResultRank
Clinical event forecastingUK Biobank 30d
AUROC72.8
7
Clinical event forecastingUK Biobank 90d
AUROC0.716
7
Clinical event forecastingUK Biobank 180d
AUROC0.701
7
Clinical event forecastingUK Biobank 365d
AUROC68.3
7
Activity Regularity EstimationUK BioBank
RMSE0.135
6
Heart-rate-variability (HRV) EstimationUK BioBank
RMSE0.129
6
Sleep Efficiency PredictionUK BioBank
RMSE0.116
6
Longitudinal risk modelingUK BioBank
AUC (365d)71.1
6
Showing 8 of 8 rows

Other info

Follow for update