Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CT-RATE

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multi-Modal Visual Question Answering (MMVQA)CT-RATE (val)
Accuracy41.92
57
Radiology Report GenerationCT-RATE (test)
BL-150.2
37
ClassificationCT-RATE
AUC0.87
29
Report generationCT-RATE
F1 Score41.4
26
Multi-label Abnormality AnalysisCT-RATE (test)
Weighted F1 Score0.972
21
Re-identificationCT-RATE
AUC97.2
18
Text-to-image retrievalCT-RATE (val)
AUC84.8
15
Abnormality diagnosisCT-RATE (internal val)
AUC84.8
13
Chest ClassificationCT-RATE (internal test)
AUROC86
13
Report GenerationCT-RATE (val)
BLEU-150.2
11
Report-to-volume retrievalCT-RATE (test)
Recall@1016
9
3D CT Multiple Choice and Report GenerationCT-RATE
MC Accuracy89.8
9
Text-to-CT GenerationCT-RATE (test)
FID 2.5D (Axial)0.271
8
Multi-label Pathology DetectionCT-RATE (val)
Macro F1 Score44.8
7
Clinical Consistency EvaluationCT-RATE (test)
AUC (Macro)78.7
7
Chest CT classificationCT-Rate 16 tasks (test)
Mean AUC83.2
7
RetrievalCT-RATE
Recall@1013.3
5
Spatial ControllabilityCT-RATE (test)
DICE0.847
5
Text-to-image retrievalCT-RATE N=1,564 (val)
Recall@517.5
3
Multiple-choice Visual Question AnsweringCT-RATE (test)
Accuracy89.741
2
Short-answer Visual Question AnsweringCT-RATE (test)
BLEU27.46
2
Long-answer Visual Question AnsweringCT-RATE (test)
BLEU47.02
2
Showing 22 of 22 rows