Training-Free Zero-Shot Anomaly Detection in 3D Brain MRI with 2D Foundation Models
About
Zero-shot anomaly detection (ZSAD) has gained increasing attention in medical imaging as a way to identify abnormalities without task-specific supervision, but most advances remain limited to 2D datasets. Extending ZSAD to 3D medical images has proven challenging, with existing methods relying on slice-wise features and vision-language models, which fail to capture volumetric structure. In this paper, we introduce a fully training-free framework for ZSAD in 3D brain MRI that constructs localized volumetric tokens by aggregating multi-axis slices processed by 2D foundation models. These 3D patch tokens restore cubic spatial context and integrate directly with distance-based, batch-level anomaly detection pipelines. The framework provides compact 3D representations that are practical to compute on standard GPUs and require no fine-tuning, prompts, or supervision. Our results show that training-free, batch-based ZSAD can be effectively extended from 2D encoders to full 3D MRI volumes, offering a simple and robust approach for volumetric anomaly detection.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Anomaly Detection | T2-weighted MRI | AUROC96.9 | 7 | |
| Anomaly Detection | BraTS METS T1-weighted MRI 2025 | AUROC0.975 | 7 | |
| 3D Anomaly Segmentation | T2-weighted MRI | AUROC92.2 | 7 | |
| Anomaly Segmentation | BraTS METS T1-weighted MRI 2025 | AUROC0.902 | 7 | |
| 3D MRI Anomaly Detection | BraTS GLI (Tumor) 2021 (test) | P-AUROC99.4 | 4 | |
| 3D MRI Anomaly Detection | ATLAS Stroke R2.0 (test) | P-AUROC87.2 | 4 |