Clinical utility of foundation models in musculoskeletal MRI for biomarker fidelity and predictive outcomes
About
Precision medicine in musculoskeletal imaging requires scalable measurement infrastructure. We developed a modular system that converts routine MRI into standardized quantitative biomarkers suitable for clinical decision support. Promptable foundation segmenters (SAM, SAM2, MedSAM) were fine-tuned across heterogeneous musculoskeletal datasets and coupled to automated detection for fully automatic prompting. Fine-tuned segmentations yielded clinically reliable measurements with high concordance to expert annotations across cartilage, bone, and soft tissue biomarkers. Using the same measurements, we demonstrate two applications: (i) a three-stage knee triage cascade that reduces verification workload while maintaining sensitivity, and (ii) 48-month landmark models that forecast knee replacement and incident osteoarthritis with favorable calibration and net benefit across clinically relevant thresholds. Our model-agnostic, open-source architecture enables independent validation and development. This work validates a pathway from automated measurement to clinical decision: reliable biomarkers drive both workload optimization today and patient risk stratification tomorrow, and the developed framework shows how foundation models can be operationalized within precision medicine systems.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Total Knee Replacement (TKR) risk prediction | Knee-replacement risk 48-96 month horizon 0-month landmark | -- | 11 | |
| Max Disc Height | Spine 2D T1sag Clinical Anatomical 88 | ICC (ICC3)97.0621 | 7 | |
| Mean T1Rho Mapping | Knee 2D MAPSS-echo1 Research Compositional 39 | ICC (ICC3)0.9973 | 6 | |
| Mean T1Rho Mapping | Knee 2D MAPSS-echo1 Research Compositional 22 | ICC (ICC3)0.9818 | 6 | |
| Mean T2 Mapping | Knee 2D MAPSS-echo1 Research Compositional 39 | ICC (ICC3)0.9347 | 6 | |
| Mean T2 Mapping | Knee 2D MAPSS-echo1 Research Compositional 22 | ICC (ICC3)0.9824 | 6 | |
| MSK MRI Segmentation | Hip 3D CUBE 42 | Dice Score97.648 | 6 | |
| MSK MRI Segmentation | Shoulder 3D CUBE 28 | Dice Score92.343 | 6 | |
| MSK MRI Segmentation | Spine 2D T1ax 59 | Dice Score93.469 | 6 | |
| MSK MRI Segmentation | Spine 2D T2ax 38 | Dice Score97.087 | 6 |