Applying speech technologies to assess verbal memory in patients with serious mental illness
Open Access
- 10 March 2020
- journal article
- research article
- Published by Springer Science and Business Media LLC in npj Digital Medicine
- Vol. 3 (1), 33
- https://doi.org/10.1038/s41746-020-0241-7
Abstract
Verbal memory deficits are some of the most profound neurocognitive deficits associated with schizophrenia and serious mental illness in general. As yet, their measurement in clinical settings is limited to traditional tests that allow for limited administrations and require substantial resources to deploy and score. Therefore, we developed a digital ambulatory verbal memory test with automated scoring, and repeated self-administration via smart devices. One hundred and four adults participated, comprising 25 patients with serious mental illness and 79 healthy volunteers. The study design was successful with high quality speech recordings produced to 92% of prompts (Patients: 86%, Healthy: 96%). The story recalls were both transcribed and scored by humans, and scores generated using natural language processing on transcriptions were comparable to human ratings (R = 0.83, within the range of human-to-human correlations of R = 0.73-0.89). A fully automated approach that scored transcripts generated by automatic speech recognition produced comparable and accurate scores (R = 0.82), with very high correlation to scores derived from human transcripts (R = 0.99). This study demonstrates the viability of leveraging speech technologies to facilitate the frequent assessment of verbal memory for clinical monitoring purposes in psychiatry.Funding Information
- Norges Forskningsråd (231395, 231395, 231395, 231395, 231395)
This publication has 40 references indexed in Scilit:
- Detecting order–disorder transitions in discourse: Implications for schizophreniaSchizophrenia Research, 2011
- An automated method to analyze language use in patients with schizophrenia and their first-degree relativesJournal of Neurolinguistics, 2010
- Verbal and visual memory: Characterizing the clinical and intermediate phenotype in schizophreniaSchizophrenia Research, 2008
- Consistency of Brief Psychiatric Rating Scale Factor Structure across a Broad Spectrum of Schizophrenia PatientsPsychopathology, 2007
- Quantifying incoherence in speech: An automated methodology and novel application to schizophreniaSchizophrenia Research, 2007
- Latent Semantic Analysis: An Improved Method to Measure Cognitive Performance in Subjects of Non-English-Speaking-BackgroundJournal of Clinical and Experimental Neuropsychology, 2006
- Latent Semantic Analysis: A New Method to Measure Prose RecallJournal of Clinical and Experimental Neuropsychology, 2002
- The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS): Preliminary Clinical ValidityJournal of Clinical and Experimental Neuropsychology, 1998
- A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge.Psychological Review, 1997
- The role of knowledge in discourse comprehension: A construction-integration model.Psychological Review, 1988