Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SKINOPATHY AI: Smartphone-Based Ophthalmic Screening and Longitudinal Tracking Using Lightweight Computer Vision

About

Early ophthalmic screening in low-resource and remote settings is constrained by access to specialized equipment and trained practitioners. We present SKINOPATHY AI, a smartphone-first web application that delivers five complementary, explainable screening modules entirely through commodity mobile hardware: (1) redness quantification via LAB a* color-space normalization; (2) blink-rate estimation using MediaPipe FaceMesh Eye Aspect Ratio (EAR) with adaptive thresholding; (3) pupil light reflex characterization through Pupil-to-Iris Ratio (PIR) time-series analysis; (4) scleral color indexing foricterus and anemia proxies via LAB/HSV statistics; and (5) iris-landmark-calibrated lesion encroachment measurement with millimeter-scale estimates and longitudinal trend tracking. The system is implemented as a React/FastAPI stack with OpenCV and MediaPipe, MongoDB-backed session persistence, and PDF report generation. All algorithms are fully deterministic, privacy-preserving, and designed for non-diagnostic consumer triage. We detail system architecture, algorithm design, evaluation methodology, clinical context, and ethical boundaries of the platform. SKINOPATHY AI demonstrates that multi-signal ophthalmic screening is feasible on unmodified smartphones without cloud-based AI inference, providing a foundation for future clinically validated mobile ophthalmoscopy tools.

S. Kalaycioglu, C. Hong, M. Zhu, H. Xie• 2026

Related benchmarks

TaskDatasetResultRank
Blink rate estimationPilot dataset Videos (pilot)
MAE (blinks/min)2.1
1
Icterus screeningPilot (pilot)
Icterus AUC79
1
Lesion TrackingPilot (pilot)
MAE (mm)0.31
1
Pupil reflex latency measurementPilot (pilot)
Latency Error (ms)42
1
Redness estimationAnterior segment photographs (pilot)
Spearman's Rho0.86
1
Showing 5 of 5 rows

Other info

Follow for update