Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Spatial Transcriptomics as Images for Large-Scale Pretraining

About

Spatial Transcriptomics (ST) profiles thousands of gene expression values at discrete spots with precise coordinates on tissue sections, preserving spatial context essential for clinical and pathological studies. With rising sequencing throughput and advancing platforms, the expanding data volumes motivate large-scale ST pretraining. However, the fundamental unit for pretraining, i.e., what constitutes a single training sample, remains ill-posed. Existing choices fall into two camps: (1) treating each spot as an independent sample, which discards spatial dependencies and collapses ST into single-cell transcriptomics; and (2) treating an entire slide as a single sample, which produces prohibitively large inputs and drastically fewer training examples, undermining effective pretraining. To address this gap, we propose treating spatial transcriptomics as croppable images. Specifically, we define a multi-channel image representation with fixed spatial size by cropping patches from raw slides, thereby preserving spatial context while substantially increasing the number of training samples. Along the channel dimension, we define gene subset selection rules to control input dimensionality and improve pretraining stability. Extensive experiments show that the proposed image-like dataset construction for ST pretraining consistently improves downstream performance, outperforming conventional pretraining schemes. Ablation studies verify that both spatial patching and channel design are necessary, establishing a unified, practical paradigm for organizing ST data and enabling large-scale pretraining.

Yishun Zhu, Jiaxin Qi, Jian Wang, Yuhua Zheng, Jianqiang Huang• 2026

Related benchmarks

TaskDatasetResultRank
Spatial domain detectionDLPFC
Accuracy75.3
9
Spatial domain detectionLymph Node (LNA) A1
Accuracy67
9
Spatial domain detectionLymph Node (LND) D1
Accuracy63.5
9
Spatial domain detectionCol
Accuracy49.1
9
Spatial domain detectionBrC
Accuracy77.3
9
Spatial domain detectionAverage
Accuracy66.2
7
Spatial domain detectionTonsil
Accuracy67.4
7
Masked region reconstructionDLPFC masking ratio 4 10x Visium (test)
MSE0.234
6
Masked region reconstructionDLPFC masking ratio 8 10x Visium (test)
MSE0.229
6
Masked region reconstructionDLPFC masking ratio 10 10x Visium (test)
MSE0.241
6
Showing 10 of 14 rows

Other info

Follow for update