IU-Xray
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Radiology report generation | IU-Xray (test) | ROUGE-L0.448 | 110 | |
| Medical Report Generation | IU-Xray (test) | ROUGE-L0.463 | 56 | |
| Findings Generation | IU-Xray (test) | BLEU-148 | 47 | |
| Medical Visual Question Answering (Multiple-Choice) | IU-XRay (test) | Accuracy96.05 | 40 | |
| Medical Visual Question Answering (True/False) | IU-XRay (test) | Accuracy97.78 | 40 | |
| Medical Visual Question Answering | IU-Xray (Close) | Accuracy86.22 | 22 | |
| Report Generation | IU-XRay | Factual Consistency (FC)85.71 | 20 | |
| Multiple-Choice Question Answering | IU-XRay | Task Utility97.16 | 20 | |
| True/False Question Answering | IU-XRay | Task Utility95.92 | 20 | |
| Radiology VQA | IU-Xray | Accuracy90.33 | 20 | |
| Medical report generation | IU-Xray | ROUGE-L44.9 | 17 | |
| Radiology report generation | IU-Xray | RaTE60.5 | 13 | |
| Clinical report generation | IU-Xray | Accuracy7.48 | 13 | |
| Radiology Report Generation | IU-Xray | ROUGE-L Score33.58 | 12 | |
| Radiology report generation | IU-Xray Findings generation v1.5 (Vicuna-7B) | ROUGE-L28.4 | 12 | |
| Medical report generation | IU-Xray | BLEU10.31 | 11 | |
| Radiology report summarization | IU-Xray | Composite Score64.71 | 10 | |
| Report Generation | IU-Xray | ROUGE-L33.1 | 10 | |
| Abnormality Classification | IU-Xray (test) | Average AUC0.9079 | 10 | |
| Radiology Report Generation | IU-Xray (full dataset) | BLEU-10.439 | 9 | |
| Medical Image Reporting | IU-Xray | BLEU-10.592 | 8 | |
| Medical Report Generation | IU-Xray OOD (test) | BLEU-128.47 | 7 | |
| Medical Report Generation | IU-Xray (evaluation) | BLEU-10.58 | 7 | |
| Medical Report Generation | IU-Xray | F1-RadGraph37.76 | 6 | |
| Findings Generation | IU Xray | 1/RadCliQ1.669 | 6 |
Showing 25 of 31 rows