VISTA-PATH: An interactive foundation model for pathology image segmentation and quantitative analysis in computational pathology
About
Accurate semantic segmentation for histopathology image is crucial for quantitative tissue analysis and downstream clinical modeling. Recent segmentation foundation models have improved generalization through large-scale pretraining, yet remain poorly aligned with pathology because they treat segmentation as a static visual prediction task. Here we present VISTA-PATH, an interactive, class-aware pathology segmentation foundation model designed to resolve heterogeneous structures, incorporate expert feedback, and produce pixel-level segmentation that are directly meaningful for clinical interpretation. VISTA-PATH jointly conditions segmentation on visual context, semantic tissue descriptions, and optional expert-provided spatial prompts, enabling precise multi-class segmentation across heterogeneous pathology images. To support this paradigm, we curate VISTA-PATH Data, a large-scale pathology segmentation corpus comprising over 1.6 million image-mask-text triplets spanning 9 organs and 93 tissue classes. Across extensive held-out and external benchmarks, VISTA-PATH consistently outperforms existing segmentation foundation models. Importantly, VISTA-PATH supports dynamic human-in-the-loop refinement by propagating sparse, patch-level bounding-box annotation feedback into whole-slide segmentation. Finally, we show that the high-fidelity, class-aware segmentation produced by VISTA-PATH is a preferred model for computational pathology. It improve tissue microenvironment analysis through proposed Tumor Interaction Score (TIS), which exhibits strong and significant associations with patient survival. Together, these results establish VISTA-PATH as a foundation model that elevates pathology image segmentation from a static prediction to an interactive and clinically grounded representation for digital pathology. Source code and demo can be found at https://github.com/zhihuanglab/VISTA-PATH.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Nuclei Segmentation | TNBC | Dice Score55.1 | 43 | |
| Nuclear Segmentation | CPM-15 | Dice Score20.8 | 23 | |
| Nuclear Segmentation | CPM 17 | Dice Score48.1 | 23 | |
| Segmentation | AGGC (internal held-out) | Dice84.5 | 5 | |
| Segmentation | BCNB (internal held-out) | Dice Coefficient87.4 | 5 | |
| Segmentation | BRCA (internal held-out) | Dice (%)69 | 5 | |
| Segmentation | DROID internal held-out | Dice Coefficient76.7 | 5 | |
| Segmentation | DROV (internal held-out) | Dice (%)87.8 | 5 | |
| Segmentation | DRYAD (internal held-out) | Dice (%)87.2 | 5 | |
| Segmentation | DigestPath (internal held-out) | Dice Score88.8 | 5 |