Improving explainability of post-separation suicide attempt prediction models for transitioning service members: insights from the Army Study to Assess Risk and Resilience in Servicemembers - Longitudinal Study.

Journal: Translational psychiatry
PMID:

Abstract

Risk of U.S. Army soldier suicide-related behaviors increases substantially after separation from service. As universal prevention programs have been unable to resolve this problem, a previously reported machine learning model was developed using pre-separation predictors to target high-risk transitioning service members (TSMs) for more intensive interventions. This model is currently being used in a demonstration project. The model is limited, though, in two ways. First, the model was developed and trained in a relatively small cross-validation sample (n = 4044) and would likely be improved if a larger sample was available. Second, the model provides no guidance on subtyping high-risk TSMs. This report presents results of an attempt to refine the model to address these limitations by re-estimating the model in a larger sample (n = 5909) and attempting to develop embedded models for differential risk of post-separation stressful life events (SLEs) known to mediate the association of model predictions with post-separation nonfatal suicide attempts (SAs; n = 4957). Analysis used data from the Army STARRS Longitudinal Surveys. The revised model improved prediction of post-separation SAs in the first year (AUC = 0.85) and second-third years (AUC = 0.77) after separation, but embedded models could not predict post-separation SLEs with enough accuracy to support intervention targeting.

Authors

  • Emily R Edwards
    VISN 2 MIRECC, Department of Veterans Affairs, Bronx, NY, USA.
  • Joseph C Geraci
    Transitioning Servicemember/Veteran and Suicide Prevention Center (TASC), VISN 2 Mental Illness Research, Education and Clinical Center, James J. Peters VA Medical Center, Bronx, New York.
  • Sarah M Gildea
    Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts.
  • Claire Houtsma
    Southeast Louisiana Veterans Health Care System, New Orleans, LA, USA.
  • Jacob A Holdcraft
    Department of Health Care Policy, Harvard Medical School, Boston, MA, USA.
  • Chris J Kennedy
    Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts.
  • Andrew J King
    University of Pittsburgh, Pittsburgh, PA, USA.
  • Alex Luedtke
    Department of Statistics, University of Washington.
  • Brian P Marx
    National Center for PTSD, VA Boston Healthcare System, Boston, Massachusetts; Department of Psychiatry, Boston University Chobanian and Avedisian School of Medicine, Boston, Massachusetts.
  • James A Naifeh
    Center for the Study of Traumatic Stress, Department of Psychiatry, Uniformed Services University School of Medicine.
  • Nancy A Sampson
    Department of Health Care Policy, Harvard Medical School.
  • Murray B Stein
    Departments of Psychiatry and Family Medicine & Public Health, University of California San Diego, and VA San Diego Healthcare System.
  • Robert J Ursano
    Center for the Study of Traumatic Stress, Department of Psychiatry, Uniformed Services University School of Medicine.
  • Ronald C Kessler
    Department of Health Care Policy, Harvard Medical School.