HSQ-VLM: A Novel Spatially-Constrained Quadrant Segmentation VLM Model for Explainability in Diabetic Retinopathy
About
Diabetic Retinopathy (DR) is an aggressive retinal disease and a leading cause of global blindness, yet its clinical management is currently hindered by the black-box nature of diagnostic AI. While deep learning models achieve high classification accuracy, there is a critical lack of explainability methods capable of detailing the exact anatomical landmarks and lesion distributions that lead to a clinical decision for DR. Therefore, we propose HSQ-VLM, a novel quadrant segmentation pipeline on fundus images that utilizes a Landmark-Anchored Cartesian Cross-Attention mechanism to unify visual feature extraction with structured clinical reasoning. Unlike traditional methods that rely on arbitrary image partitioning, our pipeline implements 4-quadrant Topological Latent Partitioning (TLP) to dynamically align retinal features with a fovea-centered coordinate system. This allows the Vision-Language Model to generate natural language reports that quantify pathology with anatomical precision. On a dataset of 3,500 high-resolution fundus images, this innovative methodology achieved a lesion detection sensitivity of 99.6% for hemorrhages and 96.4% for microaneurysms, while demonstrating a significant reduction in boundary-ambiguity errors compared to standard segmentation baselines.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Diabetic Retinopathy Classification | Diabetic Retinopathy Fundus Images (5-Fold Cross-Validation) | Mean DR Accuracy98.7 | 4 | |
| Lesion Detection | Diabetic Retinopathy Fundus Images 3,000 samples | Hemorrhage Sensitivity99.6 | 4 | |
| Lesion Localization | Diabetic Retinopathy Fundus Images 3,000 samples | MACE (Macula)2.14 | 4 | |
| Vision-Language Explainability | Diabetic Retinopathy Fundus Images 3,000 samples | Fidelity (CFS)98.2 | 2 | |
| Diabetic Retinopathy Diagnosis and Segmentation | Diabetic Retinopathy 3,000 fundus images (5-fold cross-validation) | Global AUPRC98.7 | 1 |