Novel Use of Natural Language Processing (NLP) to Predict Suicidal Ideation and Psychiatric Symptoms in a Text-Based Mental Health Intervention in Madrid.

Journal: Computational and mathematical methods in medicine
PMID: 27752278

Abstract

Natural language processing (NLP) and machine learning were used to predict suicidal ideation and heightened psychiatric symptoms among adults recently discharged from psychiatric inpatient or emergency room settings in Madrid, Spain. Participants responded to structured mental and physical health instruments at multiple follow-up points. Outcome variables of interest were suicidal ideation and psychiatric symptoms (GHQ-12). Predictor variables included structured items (e.g., relating to sleep and well-being) and responses to one unstructured question, "how do you feel today?" We compared NLP-based models using the unstructured question with logistic regression prediction models using structured data. The PPV, sensitivity, and specificity for NLP-based models of suicidal ideation were 0.61, 0.56, and 0.57, respectively, compared to 0.73, 0.76, and 0.62 of structured data-based models. The PPV, sensitivity, and specificity for NLP-based models of heightened psychiatric symptoms (GHQ-12 ≥ 4) were 0.56, 0.59, and 0.60, respectively, compared to 0.79, 0.79, and 0.85 in structured models. NLP-based models were able to generate relatively high predictive values based solely on responses to a simple general mood question. These models have promise for rapidly identifying persons at risk of suicide or psychological distress and could provide a low-cost screening alternative in settings where lengthy structured item surveys are not feasible.

Authors

  • Benjamin L Cook
    Health Equity Research Laboratory, Cambridge Health Alliance, Department of Psychiatry, Harvard Medical School, 1035 Cambridge Street, Suite 26, Cambridge, MA 02141, USA.
  • Ana M Progovac
    Health Equity Research Laboratory, Cambridge Health Alliance, Department of Psychiatry, Harvard Medical School, 1035 Cambridge Street, Suite 26, Cambridge, MA 02141, USA.
  • Pei Chen
    Wired Informatics, 265 Franklin Street, Suite 1702, Boston, MA 02110, USA.
  • Brian Mullin
    Health Equity Research Laboratory, Cambridge Health Alliance, Department of Psychiatry, Harvard Medical School, 1035 Cambridge Street, Suite 26, Cambridge, MA 02141, USA.
  • Sherry Hou
    Health Equity Research Laboratory, Cambridge Health Alliance, Department of Psychiatry, Harvard Medical School, 1035 Cambridge Street, Suite 26, Cambridge, MA 02141, USA.
  • Enrique Baca-Garcia
    Hospital Universitario Fundación Jiménez Díaz, Avda. Reyes Católicos 2, 28040 Madrid, Spain; Autonomous University of Madrid, Ciudad Universitaria de Cantoblanco, 28049 Madrid, Spain.

Keywords

External Resources

Popular Topics
Recent Journals