SheafStain: Sheaf-Theoretic Schr\"odinger Bridge for Spatially and Biologically Coherent Virtual Staining
About
Current virtual staining approaches offer the potential for time- and cost-efficient biomarker quantification in cancer diagnostics and prognostics. However, patch-wise inference for gigapixel whole slide images (WSIs) fails to maintain spatial continuity, yielding artifacts that cause catastrophic mismatches with ground-truth images. Although pathology Vision Foundation Models (VFMs) offer rich representations, their self-attention causes varying global contexts to produce inconsistent embeddings for the same physical region. We formalize and validate this ``context contamination'' as a sheaf-theoretic problem where these embeddings form a presheaf that violates the gluing axiom. To address this, we propose SheafStain, a new approach that reinterprets VFM features as sheaf-like sections for spatially and biologically coherent virtual staining. Specifically, SheafStain integrates class and patch tokens into a Schr\"odinger Bridge framework as sheaf-like sections. While the class token anchors biological consistency, patch tokens form a per-position spatial map. A backbone co-pretrained on Hematoxylin \& Eosin (H\&E) and Immunohistochemistry (IHC) yields non-degenerate cross-stain stalks, so a single VFM feature space supervises both input conditioning and output stain alignment. Departing from prior work that evaluates on isolated $256 \times 256$ patches and either random-crops or resizes the $1024 \times 1024$ ground truth, we translate at $256 \times 256$ and evaluate on the stitched $1024 \times 1024$ outputs across HER2, ER, PR, and Ki-67. SheafStain demonstrates promising results against six prior methods while mitigating patch-boundary stitching artifacts. Code will soon be released.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Virtual Staining | MIST-HER2 | FID34.508 | 53 | |
| Biomarker Quantification | MIST Ki-67 (test) | DAB-r0.0381 | 7 | |
| HER2 Low/High classification | BCI | Accuracy76.6 | 7 | |
| Virtual Staining | BCI HER2 (test) | FID36.3626 | 7 | |
| Virtual Staining | BCI HER2 | FID36.3626 | 7 | |
| Virtual Staining | MIST-ER | FID29.0824 | 7 | |
| Virtual Staining | MIST-PR | FID29.724 | 7 | |
| Virtual Staining | MIST Ki-67 | FID25.3978 | 7 | |
| Biomarker Quantification | BCI HER2 (test) | DAB-r0.0267 | 7 | |
| Biomarker Quantification | MIST HER2 (test) | DAB-r0.0487 | 7 |