The Value of Extracting Clinician-Recorded Affect for Advancing Clinical Research on Depression: Proof-of-Concept Study Applying Natural Language Processing to Electronic Health Records
Open Access
- 12 May 2022
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 6 (5), e34436
- https://doi.org/10.2196/34436
Abstract
Background: Affective characteristics are associated with depression severity, course, and prognosis. Patients’ affect captured by clinicians during sessions may provide a rich source of information that more naturally aligns with the depression course and patient-desired depression outcomes. Objective: In this paper, we propose an information extraction vocabulary used to pilot the feasibility and reliability of identifying clinician-recorded patient affective states in clinical notes from electronic health records. Methods: Affect and mood were annotated in 147 clinical notes of 109 patients by 2 independent coders across 3 pilots. Intercoder discrepancies were settled by a third coder. This reference annotation set was used to test a proof-of-concept natural language processing (NLP) system using a named entity recognition approach. Results: Concepts were frequently addressed in templated format and free text in clinical notes. Annotated data demonstrated that affective characteristics were identified in 87.8% (129/147) of the notes, while mood was identified in 97.3% (143/147) of the notes. The intercoder reliability was consistently good across the pilots (interannotator agreement [IAA] >70%). The final NLP system showed good reliability with the final reference annotation set (mood IAA=85.8%; affect IAA=80.9%). Conclusions: Affect and mood can be reliably identified in clinician reports and are good targets for NLP. We discuss several next steps to expand on this proof of concept and the value of this research for depression clinical research.This publication has 25 references indexed in Scilit:
- Psychological flexibility as a fundamental aspect of healthClinical Psychology Review, 2010
- Ambulatory emotional reactivity to negative daily life events predicts remission from major depressive disorderBehaviour Research and Therapy, 2010
- Does emotion predict the course of major depressive disorder? A review of prospective studiesBritish Journal of Clinical Psychology, 2009
- Quality Performance Measurement Using the Text of Electronic Medical RecordsMedical Decision Making, 2008
- Does processing of emotional stimuli predict symptomatic improvement and diagnostic recovery from major depression?Emotion, 2007
- Data mining for improved cardiac careACM SIGKDD Explorations Newsletter, 2006
- How Should Remission From Depression Be Defined? The Depressed Patient’s PerspectiveAmerican Journal of Psychiatry, 2006
- Sadness and amusement reactivity differentially predict concurrent and prospective functioning in major depressive disorder.Emotion, 2002
- Functional Accounts of EmotionsCognition and Emotion, 1999
- Positive and negative affectivity and their relation to anxiety and depressive disorders.Journal of Abnormal Psychology, 1988