Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Synthetic Vasculature and Pathology Enhance Vision-Language Model Reasoning

About

Vision-Language Models (VLMs) offer a promising path toward interpretable medical diagnosis by allowing users to ask about clinical explanations alongside predictions and across different modalities. However, training VLMs for detailed reasoning requires large-scale image-text datasets. In many specialized domains, for example in reading Optical Coherence Tomography Angiography (OCTA) images, such precise text with grounded description of pathologies is scarce or even non-existent. To overcome this bottleneck, we introduce Synthetic Vasculature Reasoning (SVR), a framework that controllably synthesizes images and corresponding text, specifically: realistic retinal vasculature with Diabetic Retinopathy (DR) features: capillary dropout, microaneurysms, neovascularization, and tortuosity, while automatically generating granular reasoning texts. Based on this we curate OCTA-100K-SVR, an OCTA image-reasoning dataset with 100,000 pairs. Our experiments show that a general-purpose VLM (Qwen3-VL-8b) trained on the dataset achieves a zero-shot balanced classification accuracy of 89.67% on real OCTA images, outperforming supervised baselines. Through human expert evaluation we also demonstrate that it significantly enhances explanation quality and pathology localization on clinical data.

Chenjun Li, Cheng Wan, Laurin Lux, Alexander Berger, Richard B. Rosen, Martin J. Menten, Johannes C. Paetzold• 2025

Related benchmarks

TaskDatasetResultRank
DR stagingin-house OCTA
Precision (H)95.8
8
DR stagingOCTA-500 (test)
Precision (H)97.62
8
Explanation quality evaluationIn-house dataset
Helpfulness80.8
6
Explanation quality evaluationSynthetic (test)
Helpfulness87.6
6
Showing 4 of 4 rows

Other info

Follow for update