MeFEm: Medical Face Embedding model
About
We present MeFEm, a vision model based on a modified Joint Embedding Predictive Architecture (JEPA) for biometric and medical analysis from facial images. Key modifications include an axial stripe masking strategy to focus learning on semantically relevant regions, a circular loss weighting scheme, and the probabilistic reassignment of the CLS token for high quality linear probing. Trained on a consolidated dataset of curated images, MeFEm outperforms strong baselines like FaRL and Franca on core anthropometric tasks despite using significantly less data. It also shows promising results on Body Mass Index (BMI) estimation, evaluated on a novel, consolidated closed-source dataset that addresses the domain bias prevalent in existing data. Model weights are available at https://huggingface.co/boretsyury/MeFEm , offering a strong baseline for future work in this domain.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Facial Attribute Classification | CelebA | Accuracy91 | 163 | |
| Age Classification | FairFace age | Accuracy (W)57.2 | 7 | |
| BMI estimation | BMI dataset | R^20.506 | 7 | |
| Diastolic Pressure Prediction | Clinical Medical Dataset | MAE7.14 | 4 | |
| Saturation Prediction | Clinical Medical Dataset | MAE0.8 | 4 | |
| Systolic Pressure Prediction | Clinical Medical Dataset | MAE10.8 | 4 | |
| Cholesterol Prediction | Clinical Medical Dataset | MAE0.621 | 4 | |
| Glycated hemoglobin Prediction | Clinical Medical Dataset | MAE0.47 | 4 | |
| Hemoglobin Prediction | Clinical Medical Dataset | R^20.263 | 3 |