Curia: A Multi-Modal Foundation Model for Radiology
About
AI-assisted radiological interpretation is based on predominantly narrow, single-task models. This approach is impractical for covering the vast spectrum of imaging modalities, diseases, and radiological findings. Foundation models (FMs) hold the promise of broad generalization across modalities and in low-data settings. However, this potential has remained largely unrealized in radiology. We introduce Curia, a foundation model trained on the entire cross-sectional imaging output of a major hospital over several years, which to our knowledge is the largest such corpus of real-world data-encompassing 150,000 exams (130 TB). On a newly curated 19-task external validation benchmark, Curia accurately identifies organs, detects conditions like brain hemorrhages and myocardial infarctions, and predicts outcomes in tumor staging. Curia meets or surpasses the performance of radiologists and recent foundation models, and exhibits clinically significant emergent properties in cross-modality, and low-data regimes. To accelerate progress, we release our base model's weights at https://huggingface.co/raidium/curia.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Registration | Learn2Reg Abdomen CT-CT (val) | DICE69.2 | 78 | |
| Medical Image Segmentation | AMOS Liver 22 | DSC97.3 | 15 | |
| Generalist Medical Image Analysis | CuriaBench 3D Track | Average Score86 | 11 | |
| 2D Medical Imaging Analysis | CuriaBench 2D Track 1.0 (test) | Average Score87.9 | 8 | |
| 2D Segmentation | AMOS Left kidney 22 | DSC94.5 | 5 | |
| 2D Segmentation | AMOS Stomach 22 | DSC87.6 | 5 | |
| 2D Segmentation | TotalSegmentator Organs group (standard split) | DSC81.2 | 5 | |
| 2D Segmentation | TotalSegmentator Vertebrae group (standard) | DSC81.3 | 5 | |
| 2D Segmentation | TotalSegmentator Cardiac group (standard split) | DSC80.4 | 5 | |
| 2D Segmentation | TotalSegmentator Musculoskeletal group (standard split) | DSC81.2 | 5 |