TRACE: Temporal Radiology with Anatomical Change Explanation for Grounded X-ray Report Generation
About
Temporal comparison of chest X-rays is fundamental to clinical radiology, enabling detection of disease progression, treatment response, and new findings. While vision-language models have advanced single-image report generation and visual grounding, no existing method combines these capabilities for temporal change detection. We introduce Temporal Radiology with Anatomical Change Explanation (TRACE), the first model that jointly performs temporal comparison, change classification, and spatial localization. Given a prior and current chest X-ray, TRACE generates natural language descriptions of interval changes (worsened, improved, stable) while grounding each finding with bounding box coordinates. TRACE demonstrates effective spatial localization with over 90% grounding accuracy, establishing a foundation for this challenging new task. Our ablation study uncovers an emergent capability: change detection arises only when temporal comparison and spatial grounding are jointly learned, as neither alone enables meaningful change detection. This finding suggests that grounding provides a spatial attention mechanism essential for temporal reasoning.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Temporal Classification | Chest ImaGenome | Temporal Acc48 | 3 | |
| Report Generation | Chest ImaGenome (test) | BLEU-40.26 | 1 | |
| Spatial Grounding | Chest ImaGenome | Grounding Accuracy (IoU>0.5)90.2 | 1 | |
| Temporal Change Classification | Chest ImaGenome 22,553 samples (test) | Accuracy48 | 1 | |
| Temporal Grounding | Chest ImaGenome (test) | mIoU0.772 | 1 |