Interpretable factorization of clinical questionnaires to identify latent factors of psychopathology
About
Psychiatry research seeks to understand the manifestations of psychopathology in behavior, as measured in questionnaire data, by identifying a small number of latent factors that explain them. While factor analysis is the canonical tool for this purpose, the resulting factors may not be interpretable, and may also be subject to confounding variables. Moreover, missing data are common, and explicit imputation is often required. To overcome these limitations, we introduce Interpretability Constrained Questionnaire Factorization (ICQF), a non-negative matrix factorization method with regularization tailored for questionnaire data. Our method aims to promote factor interpretability and solution stability. We provide an optimization procedure with theoretical convergence guarantees, and an automated procedure to determine latent dimensionality accurately. We validate these procedures using realistic synthetic data. We demonstrate the effectiveness of our method in a widely used general-purpose questionnaire, in two independent datasets (the Healthy Brain Network and Adolescent Brain Cognitive Development studies). Specifically, we show that ICQF preserves diagnostic information across a range of disorders, outperforming competing methods for smaller dataset sizes, and improves interpretability, as assessed by our clinical research collaborators and co-authors. This suggests that the regularization in our method matches domain characteristics, in addition to satisfying qualitative desiderata.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Factor Loading Estimation | CBCL-HBN | Pearson Correlation Coefficient0.94 | 12 | |
| Factor Loading Estimation | CBCL-ABCD | Pearson Correlation Coefficient0.84 | 12 | |
| Factor Loading Agreement | CBCL HBN and ABCD | Pearson Correlation Coefficient0.75 | 3 |