SKINOPATHY AI: Smartphone-Based Ophthalmic Screening and Longitudinal Tracking Using Lightweight Computer Vision
About
Early ophthalmic screening in low-resource and remote settings is constrained by access to specialized equipment and trained practitioners. We present SKINOPATHY AI, a smartphone-first web application that delivers five complementary, explainable screening modules entirely through commodity mobile hardware: (1) redness quantification via LAB a* color-space normalization; (2) blink-rate estimation using MediaPipe FaceMesh Eye Aspect Ratio (EAR) with adaptive thresholding; (3) pupil light reflex characterization through Pupil-to-Iris Ratio (PIR) time-series analysis; (4) scleral color indexing foricterus and anemia proxies via LAB/HSV statistics; and (5) iris-landmark-calibrated lesion encroachment measurement with millimeter-scale estimates and longitudinal trend tracking. The system is implemented as a React/FastAPI stack with OpenCV and MediaPipe, MongoDB-backed session persistence, and PDF report generation. All algorithms are fully deterministic, privacy-preserving, and designed for non-diagnostic consumer triage. We detail system architecture, algorithm design, evaluation methodology, clinical context, and ethical boundaries of the platform. SKINOPATHY AI demonstrates that multi-signal ophthalmic screening is feasible on unmodified smartphones without cloud-based AI inference, providing a foundation for future clinically validated mobile ophthalmoscopy tools.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Blink rate estimation | Pilot dataset Videos (pilot) | MAE (blinks/min)2.1 | 1 | |
| Icterus screening | Pilot (pilot) | Icterus AUC79 | 1 | |
| Lesion Tracking | Pilot (pilot) | MAE (mm)0.31 | 1 | |
| Pupil reflex latency measurement | Pilot (pilot) | Latency Error (ms)42 | 1 | |
| Redness estimation | Anterior segment photographs (pilot) | Spearman's Rho0.86 | 1 |