FetalAgents: A Multi-Agent System for Fetal Ultrasound Image and Video Analysis
About
Fetal ultrasound (US) is the primary imaging modality for prenatal screening, yet its interpretation relies heavily on the expertise of the clinician. Despite advances in deep learning and foundation models, existing automated tools for fetal US analysis struggle to balance task-specific accuracy with the whole-process versatility required to support end-to-end clinical workflows. To address these limitations, we propose FetalAgents, the first multi-agent system for comprehensive fetal US analysis. Through a lightweight, agentic coordination framework, FetalAgents dynamically orchestrates specialized vision experts to maximize performance across diagnosis, measurement, and segmentation. Furthermore, FetalAgents advances beyond static image analysis by supporting end-to-end video stream summarization, where keyframes are automatically identified across multiple anatomical planes, analyzed by coordinated experts, and synthesized with patient metadata into a structured clinical report. Extensive multi-center external evaluations across eight clinical tasks demonstrate that FetalAgents consistently delivers the most robust and accurate performance when compared against specialized models and multimodal large language models (MLLMs), ultimately providing an auditable, workflow-aligned solution for fetal ultrasound analysis and reporting.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Plane Classification | Brain Plane Classification 569 cases (ext val) | Accuracy90.9 | 7 | |
| Plane Classification | Standard Plane Classification 233 cases (Ext. val) | Accuracy92.7 | 6 | |
| Anatomical Segmentation | Stomach Segmentation 253 cases (Ext val) | DSC85.9 | 4 | |
| Fetal Biometry | AoP Estimation 64 cases (Ext val) | DSC92.8 | 4 | |
| Fetal Biometry | GA Prediction 511 cases (Ext. val) | Validity Rate84.93 | 4 | |
| Fetal Biometry | HC Measurement 75 cases (Ext. val) | DSC96.1 | 4 | |
| Anatomical Segmentation | Abdomen Segmentation Ext 187 cases (val) | DSC93.7 | 3 | |
| Fetal Biometry | AC Measurement 187 cases (Ext. val) | DSC93.7 | 3 |