Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BAAI Cardiac Agent: An intelligent multimodal agent for automated reasoning and diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging

About

Cardiac magnetic resonance (CMR) is a cornerstone for diagnosing cardiovascular disease. However, it remains underutilized due to complex, time-consuming interpretation across multi-sequences, phases, quantitative measures that heavily reliant on specialized expertise. Here, we present BAAI Cardiac Agent, a multimodal intelligent system designed for end-to-end CMR interpretation. The agent integrates specialized cardiac expert models to perform automated segmentation of cardiac structures, functional quantification, tissue characterization and disease diagnosis, and generates structured clinical reports within a unified workflow. Evaluated on CMR datasets from two hospitals (2413 patients) spanning 7-types of major cardiovascular diseases, the agent achieved an area under the receiver-operating-characteristic curve exceeding 0.93 internally and 0.81 externally. In the task of estimating left ventricular function indices, the results generated by this system for core parameters such as ejection fraction, stroke volume, and left ventricular mass are highly consistent with clinical reports, with Pearson correlation coefficients all exceeding 0.90. The agent outperformed state-of-the-art models in segmentation and diagnostic tasks, and generated clinical reports showing high concordance with expert radiologists (six readers across three experience levels). By dynamically orchestrating expert models for coordinated multimodal analysis, this agent framework enables accurate, efficient CMR interpretation and highlights its potentials for complex clinical imaging workflows. Code is available at https://github.com/plantain-herb/Cardiac-Agent.

Taiping Qu, Hongkai Zhang, Lantian Zhang, Can Zhao, Nan Zhang, Hui Wang, Zhen Zhou, Mingye Zou, Kairui Bo, Pengfei Zhao, Xingxing Jin, Zixian Su, Kun Jiang, Huan Liu, Yu Du, Maozhou Wang, Ruifang Yan, Zhongyuan Wang, Tiejun Huang, Lei Xu, Henggui Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Cardiac SegmentationCardiac CMR SAX cine
LV Myo Score92.44
15
Cardiovascular Disease DiagnosisInternal (test)
NH AUC0.98
8
Cardiovascular Disease DiagnosisExternal (val)
NH AUC93.3
8
Cardiac SegmentationCardiac CMR 4CH cine
DSC86.92
5
Cardiac SegmentationCardiac CMR SAX LGE
DSC75.07
5
CMR report generationInternal CMR Reports Junior radiologists (test)
Score87.93
5
CMR report generationInternal CMR Reports Mid radiologists (test)
Score87.52
5
CMR report generationInternal CMR Reports Senior radiologists (test)
Score86.53
5
Cardiac SegmentationSAX LGE
DSC (LV Myo)73.67
5
Cardiac Image Segmentation2CH cine
DSC (LV Myo)84.95
5
Showing 10 of 16 rows

Other info

Follow for update