Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EyeMVP: OCT-Informed Fundus Representation Learning via Paired CFP--OCT Pretraining

About

Color fundus photography (CFP) is the mainstay of large-scale retinal screening, but its diagnostic capacity is limited by the lack of depth-resolved structure, which optical coherence tomography (OCT) provides yet is less accessible at population scale. We present EyeMVP, a cross-modal retinal foundation model that uses paired CFP--OCT pretraining to learn OCT-informed CFP representations while requiring only CFP at inference. Pretrained on 674,893 same-eye same-day CFP--OCT triples from 112,642 patients across eight hospitals, EyeMVP uses cross-modal masked reconstruction to enrich CFP features with OCT-associated supervision, and combines source-constrained cross-attention with CFP-derived structural masks to accommodate the non-aligned geometry of en-face CFP and cross-sectional OCT. Across 15 dataset-level settings spanning classification and segmentation, under both full-data and few-shot regimes, EyeMVP performs on par with or better than representative retinal foundation models, with consistent gains on macular and optic-nerve tasks; it attains AUROCs of 0.923 for macular edema and 0.867 for myopic macular schisis, two conditions poorly resolved in CFP. In an exploratory reader study, EyeMVP surpasses junior and intermediate ophthalmologists but not seniors on macular edema, while exceeding all groups on myopic macular schisis. These results indicate that cross-modal reconstruction can enrich CFP representations with OCT-associated supervision, offering a practical route to stronger CFP-based screening.

Zhuo Deng, Ruiheng Zhang, Ziheng Zhang, Weihao Gao, Yitong Li, Qian Wang, Lei Shao, Jiaoyue Dong, Zhixi Zeng, Lijian Fang, Haibo Wang, Xiaobin Lin, Tao Liu, Zhicheng Du, Zhengwei Zhang, Lin Yang, Zheng Gong, Xinyu Zhao, Zhenquan Wu, Fang Li, Zhiguang Zhou, Guoming Zhang, Sun Jing, Han Lv, Wenbin We, Lan Ma• 2026

Related benchmarks

TaskDatasetResultRank
Retinal Vessel SegmentationDRIVE--
93
Age-related Macular Degeneration ClassificationIChallenge-AMD Full set Few-shot
AUROC94.21
16
Central Serous Retinopathy ClassificationPrivate CSR Few-shot (Full set)
AUROC84.38
16
Diabetic Retinopathy ClassificationMessidor-2 Full set Few-shot
AUROC92.56
16
Glaucoma ClassificationORIGA-650 Full set Few-shot
AUROC (Few-Shot)93.97
16
Glaucoma ClassificationREFUGE Full set Few-shot
AUROC97.23
16
Hard Exudate (EX) Segmentatione_opthaEX
Dice Score82.98
16
Hemorrhage (HE) SegmentationIDRID
Dice Score70.86
16
Macular Edema ClassificationPrivate (ME) Few-shot (Full set)
AUROC94.82
16
multi-disease classificationODIR5K Full set Few-shot
AUROC71.65
16
Showing 10 of 18 rows

Other info

Follow for update