Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SPARK: Stochastic Propagation via Affinity-guided Random walK for training-free unsupervised segmentation

About

We argue that existing training-free segmentation methods rely on an implicit and limiting assumption, that segmentation is a spectral graph partitioning problem over diffusion-derived affinities. Such approaches, based on global graph partitioning and eigenvector-based formulations of affinity matrices, suffer from several fundamental drawbacks, they require pre-selecting the number of clusters, induce boundary oversmoothing due to spectral relaxation, and remain highly sensitive to noisy or multi-modal affinity distributions. Moreover, many prior works neglect the importance of local neighborhood structure, which plays a crucial role in stabilizing affinity propagation and preserving fine-grained contours. To address these limitations, we reformulate training-free segmentation as a stochastic flow equilibrium problem over diffusion-induced affinity graphs, where segmentation emerges from a stochastic propagation process that integrates global diffusion attention with local neighborhoods extracted from stable diffusion, yielding a sparse yet expressive affinity structure. Building on this formulation, we introduce a Markov propagation scheme that performs random-walk-based label diffusion with an adaptive pruning strategy that suppresses unreliable transitions while reinforcing confident affinity paths. Experiments across seven widely used semantic segmentation benchmarks demonstrate that our method achieves state-of-the-art zero-shot performance, producing sharper boundaries, more coherent regions, and significantly more stable masks compared to prior spectral-clustering-based approaches.

Kunal Mahatha, Jose Dolz, Christian Desrosiers• 2026

Related benchmarks

TaskDatasetResultRank
Semantic segmentationADE20K
mIoU48
936
Semantic segmentationCityscapes
mIoU33.9
578
Semantic segmentationPascal VOC
mIoU0.669
172
Semantic segmentationCOCO Object
mIoU42.7
73
Semantic segmentationPascal Context
mIoU57.7
43
Semantic segmentationCOCO-Stuff 27
mIoU52
40
Showing 6 of 6 rows

Other info

Follow for update