Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PAINT: Pathology-Aware Integrated Next-Scale Transformation for Virtual Immunohistochemistry

About

Virtual immunohistochemistry (IHC) aims to computationally synthesize molecular staining patterns from routine Hematoxylin and Eosin (H\&E) images, offering a cost-effective and tissue-efficient alternative to traditional physical staining. However, this task is particularly challenging: H\&E morphology provides ambiguous cues about protein expression, and similar tissue structures may correspond to distinct molecular states. Most existing methods focus on direct appearance synthesis to implicitly achieve cross-modal generation, often resulting in semantic inconsistencies due to insufficient structural priors. In this paper, we propose Pathology-Aware Integrated Next-Scale Transformation (PAINT), a visual autoregressive framework that reformulates the synthesis process as a structure-first conditional generation task. Unlike direct image translation, PAINT enforces a causal order by resolving molecular details conditioned on a global structural layout. Central to this approach is the introduction of a Spatial Structural Start Map (3S-Map), which grounds the autoregressive initialization in observed morphology, ensuring deterministic, spatially aligned synthesis. Experiments on the IHC4BC and MIST datasets demonstrate that PAINT outperforms state-of-the-art methods in structural fidelity and clinical downstream tasks, validating the potential of structure-guided autoregressive modeling.

Rongze Ma, Mengkang Lu, Zhenyu Xiang, Yongsheng Pan, Yicheng Wu, Qingjie Zeng, Yong Xia• 2026

Related benchmarks

TaskDatasetResultRank
H-score PredictionIHC4BC PR
R20.5232
11
Immunohistochemistry Estrogen Receptor QuantificationIHC4BC-ER
H.Score R^20.7354
11
Positive Percentage PredictionIHC4BC Ki67
R20.6819
11
HER2 ClassificationIHC4BC-HER2+HE
Accuracy97.53
10
Virtual IHC SynthesisIHC4BC-HER2 (test)
SSIM0.2792
9
Virtual IHC SynthesisIHC4BC-Ki67 (test)
SSIM55.92
9
Virtual ImmunohistochemistryMIST-PR
SSIM0.2326
9
Virtual ImmunohistochemistryMIST-HER2
SSIM0.1983
9
Virtual IHC SynthesisIHC4BC-ER (test)
SSIM70.15
9
Virtual ImmunohistochemistryMIST-ER
SSIM0.2205
9
Showing 10 of 12 rows

Other info

Follow for update