Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Resolution scaling governs DINOv3 transfer performance in chest radiograph classification

About

Self-supervised learning (SSL) has improved visual representation learning, but its value in chest radiography remains uncertain. DINOv3 extends earlier SSL models through Gram-anchored self-distillation and explicit high-resolution adaptation. Whether these changes improve transfer learning for chest radiograph classification has not been established. We benchmarked DINOv3 against DINOv2 and supervised ImageNet initialization across seven chest radiograph datasets comprising 816,183 radiographs from pediatric and adult cohorts. ViT-B/16 and ConvNeXt-B were evaluated under full fine-tuning at 224 and 512 pixels, with targeted 1024 experiments on three cohorts. Additional analyses examined parameter-efficient adaptation, synthetic label corruption, external validation, frozen 7B features, and computational efficiency. The primary outcome was mean AUROC across labels. In adult cohorts, DINOv3 did not consistently outperform DINOv2 at 224 x 224 pixels, but became the strongest initialization at 512 x 512, especially with ConvNeXt-B. Gains were greatest for small focal and boundary-dependent abnormalities, whereas large-structure findings changed little. The pediatric cohort showed no significant benefit from DINOv3, higher resolution, or backbone choice. Scaling to 1024 x 1024 rarely improved performance and markedly increased computational cost. ConvNeXt-B remained superior to ViT-B/16 under both full and parameter-efficient adaptation. External validation preserved the 512 x 512 DINOv3 advantage, whereas synthetic label corruption showed that this benefit should not be interpreted simply as superior noise robustness. For adult chest radiograph classification, DINOv3 provides its most reliable benefit at 512 x 512 pixels, particularly with ConvNeXt-B. Fully adapted mid-sized models at 512 x 512 pixels provided the best performance-cost trade-off in our benchmark.

Soroosh Tayebi Arasteh, Mina Shaigan, Christiane Kuhl, Jakob Nikolas Kather, Sven Nebelung, Daniel Truhn• 2025

Related benchmarks

TaskDatasetResultRank
ClassificationChestX-Ray14 (test)
AUROC0.823
34
Chest X-ray classificationCheXpert (test)--
27
Chest radiograph classificationPedi-CXR (test)
AUROC74.1
10
Chest radiograph classificationVinDr-CXR (test)
AUROC0.905
10
Chest radiograph classificationPadChest (test)
AUROC0.893
10
Chest radiograph classificationMIMIC-CXR (test)
AUROC0.827
10
Chest radiograph classificationUKA-CXR (test)
AUROC88.5
10
Showing 7 of 7 rows

Other info

Follow for update