Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HSQ-VLM: A Novel Spatially-Constrained Quadrant Segmentation VLM Model for Explainability in Diabetic Retinopathy

About

Diabetic Retinopathy (DR) is an aggressive retinal disease and a leading cause of global blindness, yet its clinical management is currently hindered by the black-box nature of diagnostic AI. While deep learning models achieve high classification accuracy, there is a critical lack of explainability methods capable of detailing the exact anatomical landmarks and lesion distributions that lead to a clinical decision for DR. Therefore, we propose HSQ-VLM, a novel quadrant segmentation pipeline on fundus images that utilizes a Landmark-Anchored Cartesian Cross-Attention mechanism to unify visual feature extraction with structured clinical reasoning. Unlike traditional methods that rely on arbitrary image partitioning, our pipeline implements 4-quadrant Topological Latent Partitioning (TLP) to dynamically align retinal features with a fovea-centered coordinate system. This allows the Vision-Language Model to generate natural language reports that quantify pathology with anatomical precision. On a dataset of 3,500 high-resolution fundus images, this innovative methodology achieved a lesion detection sensitivity of 99.6% for hemorrhages and 96.4% for microaneurysms, while demonstrating a significant reduction in boundary-ambiguity errors compared to standard segmentation baselines.

Shivum Telang• 2026

Related benchmarks

TaskDatasetResultRank
Diabetic Retinopathy ClassificationDiabetic Retinopathy Fundus Images (5-Fold Cross-Validation)
Mean DR Accuracy98.7
4
Lesion DetectionDiabetic Retinopathy Fundus Images 3,000 samples
Hemorrhage Sensitivity99.6
4
Lesion LocalizationDiabetic Retinopathy Fundus Images 3,000 samples
MACE (Macula)2.14
4
Vision-Language ExplainabilityDiabetic Retinopathy Fundus Images 3,000 samples
Fidelity (CFS)98.2
2
Diabetic Retinopathy Diagnosis and SegmentationDiabetic Retinopathy 3,000 fundus images (5-fold cross-validation)
Global AUPRC98.7
1
Showing 5 of 5 rows

Other info

Follow for update