PAINT: Pathology-Aware Integrated Next-Scale Transformation for Virtual Immunohistochemistry
About
Virtual immunohistochemistry (IHC) aims to computationally synthesize molecular staining patterns from routine Hematoxylin and Eosin (H\&E) images, offering a cost-effective and tissue-efficient alternative to traditional physical staining. However, this task is particularly challenging: H\&E morphology provides ambiguous cues about protein expression, and similar tissue structures may correspond to distinct molecular states. Most existing methods focus on direct appearance synthesis to implicitly achieve cross-modal generation, often resulting in semantic inconsistencies due to insufficient structural priors. In this paper, we propose Pathology-Aware Integrated Next-Scale Transformation (PAINT), a visual autoregressive framework that reformulates the synthesis process as a structure-first conditional generation task. Unlike direct image translation, PAINT enforces a causal order by resolving molecular details conditioned on a global structural layout. Central to this approach is the introduction of a Spatial Structural Start Map (3S-Map), which grounds the autoregressive initialization in observed morphology, ensuring deterministic, spatially aligned synthesis. Experiments on the IHC4BC and MIST datasets demonstrate that PAINT outperforms state-of-the-art methods in structural fidelity and clinical downstream tasks, validating the potential of structure-guided autoregressive modeling.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| H-score Prediction | IHC4BC PR | R20.5232 | 11 | |
| Immunohistochemistry Estrogen Receptor Quantification | IHC4BC-ER | H.Score R^20.7354 | 11 | |
| Positive Percentage Prediction | IHC4BC Ki67 | R20.6819 | 11 | |
| HER2 Classification | IHC4BC-HER2+HE | Accuracy97.53 | 10 | |
| Virtual IHC Synthesis | IHC4BC-HER2 (test) | SSIM0.2792 | 9 | |
| Virtual IHC Synthesis | IHC4BC-Ki67 (test) | SSIM55.92 | 9 | |
| Virtual Immunohistochemistry | MIST-PR | SSIM0.2326 | 9 | |
| Virtual Immunohistochemistry | MIST-HER2 | SSIM0.1983 | 9 | |
| Virtual IHC Synthesis | IHC4BC-ER (test) | SSIM70.15 | 9 | |
| Virtual Immunohistochemistry | MIST-ER | SSIM0.2205 | 9 |