Mantis: Lightweight Calibrated Foundation Model for User-Friendly Time Series Classification
About
In recent years, there has been increasing interest in developing foundation models for time series data that can generalize across diverse downstream tasks. While numerous forecasting-oriented foundation models have been introduced, there is a notable scarcity of models tailored for time series classification. To address this gap, we present Mantis, a new open-source foundation model for time series classification based on the Vision Transformer (ViT) architecture that has been pre-trained using a contrastive learning approach. Our experimental results show that Mantis outperforms existing foundation models both when the backbone is frozen and when fine-tuned, while achieving the lowest calibration error. In addition, we propose several adapters to handle the multivariate setting, reducing memory requirements and modeling channel interdependence.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Binary Classification (Cognitive load/relax) | USILaughs (Leave-one-participant-out (LOPO)) | Balanced Accuracy72 | 7 | |
| Binary Classification (Sleep/Wake) | Dreamt Time-Aware (TA) | Balanced Accuracy73 | 7 | |
| Binary Classification (Sleep/Wake) | HeartS Time-Aware (TA) | Balanced Accuracy75 | 7 | |
| Binary Classification (Sleep/Wake) | HeartS (Leave-one-participant-out (LOPO)) | Balanced Accuracy74 | 7 | |
| Binary Classification (Deep Sleep/REM) | Dreamt Time-Aware (TA) | Balanced Accuracy64 | 7 | |
| Binary Classification (Low/High engagement) | APSYNC Time-Aware (TA) | Balanced Accuracy86 | 7 | |
| Binary Classification (Sleep/Wake) | Dreamt (Leave-one-participant-out (LOPO)) | Balanced Accuracy76 | 7 | |
| Binary Classification (Stress/calm) | HHISS (Leave-one-participant-out (LOPO)) | Balanced Accuracy63 | 7 | |
| Binary Classification (Low/High Valence) | WESAD Time-Aware (TA) | Balanced Accuracy61 | 7 | |
| Binary Classification (Low/High Arousal) | WESAD (Leave-one-participant-out (LOPO)) | Balanced Acc56 | 7 |