Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DiaLLMs: EHR Enhanced Clinical Conversational System for Clinical Test Recommendation and Diagnosis Prediction

About

Recent advances in Large Language Models (LLMs) have led to remarkable progresses in medical consultation. However, existing medical LLMs overlook the essential role of Electronic Health Records (EHR) and focus primarily on diagnosis recommendation, limiting their clinical applicability. We propose DiaLLM, the first medical LLM that integrates heterogeneous EHR data into clinically grounded dialogues, enabling clinical test recommendation, result interpretation, and diagnosis prediction to better align with real-world medical practice. To construct clinically grounded dialogues from EHR, we design a Clinical Test Reference (CTR) strategy that maps each clinical code to its corresponding description and classifies test results as "normal" or "abnormal". Additionally, DiaLLM employs a reinforcement learning framework for evidence acquisition and automated diagnosis. To handle the large action space, we introduce a reject sampling strategy to reduce redundancy and improve exploration efficiency. Furthermore, a confirmation reward and a class-sensitive diagnosis reward are designed to guide accurate diagnosis prediction. Extensive experimental results demonstrate that DiaLLM outperforms baselines in clinical test recommendation and diagnosis prediction.

Weijieying Ren, Tianxiang Zhao, Lei Wang, Tianchun Wang, Vasant Honavar• 2025

Related benchmarks

TaskDatasetResultRank
Diagnosis predictionTriNetX-Metabolic Multi-turn Dialogue
Recall@570.22
11
Diagnosis predictionTriNetX-Respiratory Multi-turn Dialogue
Recall@570.89
11
Diagnosis predictionTriNetX-Circulatory Multi-turn Dialogue
Recall@50.7111
11
Diagnosis predictionNHANES (test)
Recall@195.94
11
Lab Test RecommendationTriNetX-Metabolic Multi-turn Dialogue
Recall@511.43
11
Lab Test RecommendationTriNetX-Respiratory Multi-turn Dialogue
Recall@512.31
11
Lab Test RecommendationTriNetX-Circulatory Multi-turn Dialogue
Recall@511.55
11
Single-turn DialogueTriNetX Metabolic
Recall@579.54
11
Single-turn DialogueTriNetX-Respiratory
Recall@50.7819
11
Single-turn DialogueTriNetX Circulatory
Recall@577.75
11
Showing 10 of 10 rows

Other info

Code

Follow for update