FCUS-rPPG: A Fast-Converging Unsupervised Framework for Remote Photoplethysmography via Gradient Oscillation Suppression
About
Remote photoplethysmography (rPPG) enables non-contact extraction of blood volume pulse (BVP) signals using consumer-grade cameras. Recent unsupervised rPPG methods learn BVP representations without requiring ground-truth physiological annotations, yet their optimization is often hindered by noisy and unstable gradients, resulting in slow convergence and limited cross-domain generalization. In this paper, we propose FCUS-rPPG, a fast-converging unsupervised rPPG framework with strong generalization capability. Motivated by the observation that BVP representations exhibit both multi-spectral covariation and low-dimensional manifold structure, we design a spectrally shared backbone that facilitates BVP feature disentanglement while improving optimization efficiency. To jointly enhance convergence stability and generalization performance, we further develop a unified optimization framework operating at the gradient, loss-landscape, and feature-representation levels. Specifically, a post-verification masking mechanism filters out misleading gradients according to the weak-amplitude physiological prior of BVP signals; a perturbation-based loss landscape smoothing strategy steers optimization toward more generalizable flat minima; and a noise-aware null-space regularization constrains feature updates to the orthogonal complement of the noise subspace, thereby mitigating noise-induced representation drift. Extensive experiments on five datasets demonstrate that FCUS-rPPG requires only one training epoch, whereas existing methods typically require tens to hundreds of epochs. Notably, FCUS-rPPG consistently achieves state-of-the-art (SOTA) performance in cross-dataset evaluations. This study provides an efficient and robust solution to the real-world deployment of unsupervised rPPG. The source code will be publicly available at https://github.com/JiaJieLee/FCUS-rPPG.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Heart Rate estimation | UBFC-rPPG (test) | MAE0.31 | 69 | |
| Pulse Rate Estimation | UBFC-rPPG to PURE (test) | MAE (BPM)0.49 | 50 | |
| Heart Rate estimation | MMPD trained on UBFC (test) | MAE (BPM)8.96 | 23 | |
| HR estimation | PURE (five-fold cross-validation) | MAE0.49 | 22 | |
| Heart Rate estimation | PURE to UBFC-rPPG (train-test cross) | MAE (bpm)0.71 | 15 | |
| Heart Rate estimation | BSIPL-RPPG (5-fold subject-independent cross-validation) | MAE (bpm)1.32 | 9 | |
| Heart Rate estimation | UBFC-rPPG to BSIPL-motion (train-test cross) | MAE (bpm)0.55 | 8 | |
| Heart Rate estimation | BSIPL-RPPG cross-dataset (trained on UBFC-rPPG) | MAE (bpm)1.61 | 7 | |
| Heart Rate estimation | PURE cross-dataset (trained on BSIPL-motion) | MAE (bpm)0.6 | 7 | |
| Remote Photoplethysmography (rPPG) | PURE (test) | MAE0.49 | 6 |