Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Pathological Semantics-Preserving Learning for H&E-to-IHC Virtual Staining

About

Conventional hematoxylin-eosin (H&E) staining is limited to revealing cell morphology and distribution, whereas immunohistochemical (IHC) staining provides precise and specific visualization of protein activation at the molecular level. Virtual staining technology has emerged as a solution for highly efficient IHC examination, which directly transforms H&E-stained images to IHC-stained images. However, virtual staining is challenged by the insufficient mining of pathological semantics and the spatial misalignment of pathological semantics. To address these issues, we propose the Pathological Semantics-Preserving Learning method for Virtual Staining (PSPStain), which directly incorporates the molecular-level semantic information and enhances semantics interaction despite any spatial inconsistency. Specifically, PSPStain comprises two novel learning strategies: 1) Protein-Aware Learning Strategy (PALS) with Focal Optical Density (FOD) map maintains the coherence of protein expression level, which represents molecular-level semantic information; 2) Prototype-Consistent Learning Strategy (PCLS), which enhances cross-image semantic interaction by prototypical consistency learning. We evaluate PSPStain on two public datasets using five metrics: three clinically relevant metrics and two for image quality. Extensive experiments indicate that PSPStain outperforms current state-of-the-art H&E-to-IHC virtual staining methods and demonstrates a high pathological correlation between the staging of real and virtual stains.

Fuqiang Chen, Ranran Zhang, Boyun Zheng, Yiwen Sun, Jiahui He, Wenjian Qin• 2024

Related benchmarks

TaskDatasetResultRank
H-score PredictionIHC4BC PR
R20.1501
11
Immunohistochemistry Estrogen Receptor QuantificationIHC4BC-ER
H.Score R^20.386
11
Positive Percentage PredictionIHC4BC Ki67
R20.4806
11
Virtual StainingBCI Class 1+
SSIM38.61
10
HER2 ClassificationIHC4BC-HER2+HE
Accuracy83.5
10
Virtual StainingMIST-ER
SSIM0.1268
10
Virtual StainingMIST Ki67
SSIM0.1336
10
Virtual StainingBCI Class 0
SSIM41.7
10
Virtual StainingBCI Class 2+
SSIM0.3493
10
Virtual StainingBCI Class 3+
SSIM32.42
10
Showing 10 of 23 rows

Other info

Code

Follow for update