Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initialization

About

2D visual foundation models, such as DINOv3, a self-supervised model trained on large-scale natural images, have demonstrated strong zero-shot generalization, capturing both rich global context and fine-grained structural cues. However, an analogous 3D foundation model for downstream volumetric neuroimaging remains lacking, largely due to the challenges of 3D image acquisition and the scarcity of high-quality annotations. To address this gap, we propose to adapt the 2D visual representations learned by DINOv3 to a 3D biomedical segmentation model, enabling more data-efficient and morphologically faithful neuronal reconstruction. Specifically, we design an inflation-based adaptation strategy that inflates 2D filters into 3D operators, preserving semantic priors from DINOv3 while adapting to 3D neuronal volume patches. In addition, we introduce a topology-aware skeleton loss to explicitly enforce structural fidelity of graph-based neuronal arbor reconstruction. Extensive experiments on four neuronal imaging datasets, including two from BigNeuron and two public datasets, NeuroFly and CWMBS, demonstrate consistent improvements in reconstruction accuracy over SoTA methods, with average gains of 2.9% in Entire Structure Average, 2.8% in Different Structure Average, and 3.8% in Percentage of Different Structure. Code: https://github.com/yy0007/NeurINO.

Yik San Cheng, Runkai Zhao, Weidong Cai• 2026

Related benchmarks

TaskDatasetResultRank
Neuron TracingMouse
ESA2.81
12
Neuron TracingNeuroFly
ESA23.61
12
Neuron TracingCWMBS
ESA34.09
12
Neuron TracingDrosophila
ESA1.84
12
Neuron TracingMouse BigNeuron (test)
ESA2.81
8
Neuron TracingNeuroFly VISoR/fMOST (test)
ESA23.61
8
Neuron TracingDrosophila BigNeuron (test)
ESA1.84
8
Neuron TracingCWMBS (test)
ESA34.09
8
Neuron SegmentationDrosophila
F1 Score (%)50.19
6
Neuron SegmentationMouse
F1 Score (%)52.73
6
Showing 10 of 16 rows

Other info

Follow for update