Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Camyla: Scaling Autonomous Research in Medical Image Segmentation

About

We present Camyla, a system for fully autonomous research within the scientific domain of medical image segmentation. Camyla transforms raw datasets into literature-grounded research proposals, executable experiments, and complete manuscripts without human intervention. Autonomous experimentation over long horizons poses three interrelated challenges: search effort drifts toward unpromising directions, knowledge from earlier trials degrades as context accumulates, and recovery from failures collapses into repetitive incremental fixes. To address these challenges, the system combines three coupled mechanisms: Quality-Weighted Branch Exploration for allocating effort across competing proposals, Layered Reflective Memory for retaining and compressing cross-trial knowledge at multiple granularities, and Divergent Diagnostic Feedback for diversifying recovery after underperforming trials. The system is evaluated on CamylaBench, a contamination-free benchmark of 31 datasets constructed exclusively from 2025 publications, under a strict zero-intervention protocol across two independent runs within a total of 28 days on an 8-GPU cluster. Across the two runs, Camyla generates more than 2,700 novel model implementations and 40 complete manuscripts, and surpasses the strongest per-dataset baseline selected from 14 established architectures, including nnU-Net, on 22 and 18 of 31 datasets under identical training budgets, respectively (union: 24/31). Senior human reviewers score the generated manuscripts at the T1/T2 boundary of contemporary medical imaging journals. Relative to automated baselines, Camyla outperforms AutoML and NAS systems on aggregate segmentation performance and exceeds six open-ended research agents on both task completion and baseline-surpassing frequency. These results suggest that domain-scale autonomous research is achievable in medical image segmentation.

Yifan Gao, Haoyue Li, Feng Yuan, Xin Gao, Weiran Huang, Xiaosong Wang• 2026

Related benchmarks

TaskDatasetResultRank
Medical Image SegmentationMSLesSeg
Dice Score70.63
16
Medical Image SegmentationGDMRI-CT (val)
Dice Score73.87
13
Medical Image SegmentationPNPC (val)
Dice61.95
13
Medical Image SegmentationAMSMC-HTM (val)
Dice Coefficient82.89
13
Medical Image SegmentationMRE-BSA (val)
Dice Coefficient70.4
13
Medical Image SegmentationNLSTseg (val)
Dice Score41.78
13
Medical Image SegmentationSMRI-FB
Dice Score86.44
9
Medical Image SegmentationLMD-BM
Dice Score51.51
9
Medical Image SegmentationBONBID 2023
Dice Coefficient58.23
9
Medical Image SegmentationBTXRD
Dice49.89
9
Showing 10 of 49 rows

Other info

Follow for update