Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Knowledge-Guided Retrieval-Augmented Generation for Zero-Shot Psychiatric Data: Privacy Preserving Synthetic Data Generation

About

AI systems in healthcare research have shown potential to increase patient throughput and assist clinicians, yet progress is constrained by limited access to real patient data. To address this issue, we present a zero-shot, knowledge-guided framework for psychiatric tabular data in which large language models (LLMs) are steered via Retrieval-Augmented Generation using the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) and the International Classification of Diseases (ICD-10). We conducted experiments using different combinations of knowledge bases to generate privacy-preserving synthetic data. The resulting models were benchmarked against two state-of-the-art deep learning models for synthetic tabular data generation, namely CTGAN and TVAE, both of which rely on real data and therefore entail potential privacy risks. Evaluation was performed on six anxiety-related disorders: specific phobia, social anxiety disorder, agoraphobia, generalized anxiety disorder, separation anxiety disorder, and panic disorder. CTGAN typically achieves the best marginals and multivariate structure, while the knowledge-augmented LLM is competitive on pairwise structure and attains the lowest pairwise error in separation anxiety and social anxiety. An ablation study shows that clinical retrieval reliably improves univariate and pairwise fidelity over a no-retrieval LLM. Privacy analyses indicate that the real data-free LLM yields modest overlaps and a low average linkage risk comparable to CTGAN, whereas TVAE exhibits extensive duplication despite a low k-map score. Overall, grounding an LLM in clinical knowledge enables high-quality, privacy-preserving synthetic psychiatric data when real datasets are unavailable or cannot be shared.

Adam Jakobsen, Sushant Gautam, Hugo Lewi Hammer, Susanne Olofsdotter, Miriam S Johanson, P{\aa}l Halvorsen, Vajira Thambawita• 2026

Related benchmarks

TaskDatasetResultRank
Privacy EvaluationAgoraphobia
Exact Overlap29.6
7
Privacy EvaluationGeneralized Anxiety
Exact Overlap2.1
7
Privacy EvaluationPanic
Exact Overlap24.6
7
Privacy EvaluationSeparation Anxiety subset
Exact Overlap22
7
Privacy EvaluationSocial Anxiety
Exact Overlap8
7
Privacy EvaluationSpecific Phobia
Exact Overlap18.4
7
Synthetic Data Fidelity EvaluationPanic
JSD0.082
7
Synthetic Data Fidelity EvaluationSeparation Anxiety
JSD0.076
7
Synthetic Data Fidelity EvaluationSocial Anxiety
JSD0.088
7
Synthetic Data Fidelity EvaluationSpecific Phobia
JSD0.113
7
Showing 10 of 12 rows

Other info

Follow for update