Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Ontology-driven weak supervision for clinical entity classification in electronic health records

About

In the electronic health record, using clinical notes to identify entities such as disorders and their temporality (e.g. the order of an event relative to a time index) can inform many important analyses. However, creating training data for clinical entity tasks is time consuming and sharing labeled data is challenging due to privacy concerns. The information needs of the COVID-19 pandemic highlight the need for agile methods of training machine learning models for clinical notes. We present Trove, a framework for weakly supervised entity classification using medical ontologies and expert-generated rules. Our approach, unlike hand-labeled notes, is easy to share and modify, while offering performance comparable to learning from manually labeled training data. In this work, we validate our framework on six benchmark tasks and demonstrate Trove's ability to analyze the records of patients visiting the emergency department at Stanford Health Care for COVID-19 presenting symptoms and risk factors.

Jason A. Fries, Ethan Steinberg, Saelig Khattar, Scott L. Fleming, Jose Posada, Alison Callahan, Nigam H. Shah• 2020

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionBC5CDR
F1 Score92.4
59
Drug Named Entity Recognitioni2b2 2009
F1 Score93.2
8
Disorder Named Entity RecognitionShARe CLEFE
F1 Score79.6
8
Symptom/Disorder TaggingStanford Health Care emergency department notes COVID-19 case study 1.0
Precision73
7
Temporal Relation Classification (DocTimeRel)THYME
F1 Score86.2
5
Negation DetectionClinical Notes
F1 Score96.1
4
COVID Exposure ClassificationStanford Health Care emergency department notes COVID-19 case study 1.0
Precision87.2
3
Showing 7 of 7 rows

Other info

Code

Follow for update