Universal CT Representations from Anatomy to Disease Phenotype through Agglomerative Pretraining
About
Computed tomography (CT) is a central to three-dimensional medical imaging, yet CT-based artificial intelligence remains fragmented across task-specific models for segmentation, classification, registration, and report analysis. Here we present FlexiCT, a family of CT foundation models trained by agglomerative continual pretraining on 266,227 CT volumes from 56 publicly available datasets, forming a large-scale public resource for CT representation learning. FlexiCT uses agglomerative pretraining across three stages: two-dimensional axial pretraining, three-dimensional anatomical pretraining and report-guided semantic alignment. This training strategy supports slice-level, volume-level and vision-language analysis. Across five downstream task families (segmentation, classification, registration, vision-language understanding and clinical retrieval), FlexiCT matches or exceeds prior task-specific approaches on multiple benchmarks. Its embeddings further organize CT scans along gradients associated with various tumor stages, suggesting that CT foundation models can capture imaging features relevant to disease phenotype characterization. Project page and code are available at: https://ricklisz.github.io/flexict.github.io and https://github.com/ricklisz/FlexiCT.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Registration | Learn2Reg Abdomen CT-CT (val) | DICE90.1 | 78 | |
| Medical Image Segmentation | MSD Pancreas (test) | DSC83.9 | 30 | |
| 3D Segmentation | MSD-Liver | DSC96 | 15 | |
| Medical Image Segmentation | AMOS Liver 22 | DSC97.8 | 15 | |
| Visual Segmentation | KiTS23 | KTC Dice Score0.979 | 14 | |
| Retrieval | CT-RATE | Recall@1046.2 | 9 | |
| Medical Image Segmentation | MSD Lung (test) | Dice (Label 1)73.8 | 6 | |
| 2D Segmentation | AMOS Spleen 22 | DSC94.5 | 5 | |
| 2D Segmentation | AMOS22 Right kidney | DSC96.5 | 5 | |
| 2D Segmentation | AMOS Left kidney 22 | DSC94.9 | 5 |