DiaLLMs: EHR Enhanced Clinical Conversational System for Clinical Test Recommendation and Diagnosis Prediction
About
Recent advances in Large Language Models (LLMs) have led to remarkable progresses in medical consultation. However, existing medical LLMs overlook the essential role of Electronic Health Records (EHR) and focus primarily on diagnosis recommendation, limiting their clinical applicability. We propose DiaLLM, the first medical LLM that integrates heterogeneous EHR data into clinically grounded dialogues, enabling clinical test recommendation, result interpretation, and diagnosis prediction to better align with real-world medical practice. To construct clinically grounded dialogues from EHR, we design a Clinical Test Reference (CTR) strategy that maps each clinical code to its corresponding description and classifies test results as "normal" or "abnormal". Additionally, DiaLLM employs a reinforcement learning framework for evidence acquisition and automated diagnosis. To handle the large action space, we introduce a reject sampling strategy to reduce redundancy and improve exploration efficiency. Furthermore, a confirmation reward and a class-sensitive diagnosis reward are designed to guide accurate diagnosis prediction. Extensive experimental results demonstrate that DiaLLM outperforms baselines in clinical test recommendation and diagnosis prediction.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Diagnosis prediction | TriNetX-Metabolic Multi-turn Dialogue | Recall@570.22 | 11 | |
| Diagnosis prediction | TriNetX-Respiratory Multi-turn Dialogue | Recall@570.89 | 11 | |
| Diagnosis prediction | TriNetX-Circulatory Multi-turn Dialogue | Recall@50.7111 | 11 | |
| Diagnosis prediction | NHANES (test) | Recall@195.94 | 11 | |
| Lab Test Recommendation | TriNetX-Metabolic Multi-turn Dialogue | Recall@511.43 | 11 | |
| Lab Test Recommendation | TriNetX-Respiratory Multi-turn Dialogue | Recall@512.31 | 11 | |
| Lab Test Recommendation | TriNetX-Circulatory Multi-turn Dialogue | Recall@511.55 | 11 | |
| Single-turn Dialogue | TriNetX Metabolic | Recall@579.54 | 11 | |
| Single-turn Dialogue | TriNetX-Respiratory | Recall@50.7819 | 11 | |
| Single-turn Dialogue | TriNetX Circulatory | Recall@577.75 | 11 |