Development and external validation of a logistic and a penalized logistic model using machine-learning techniques to predict suicide attempts: A multicenter prospective cohort study in Korea.

Journal: Journal of psychiatric research
PMID:

Abstract

Despite previous efforts to build statistical models for predicting the risk of suicidal behavior using machine-learning analysis, a high-accuracy model can lead to overfitting. Furthermore, internal validation cannot completely address this problem. In this study, we created models for predicting the occurrence of suicide attempts among Koreans at high risk of suicide, and we verified these models in an independent cohort. We performed logistic and penalized regression for suicide attempts within 6 months among suicidal ideators and attempters in The Korean Cohort for the Model Predicting a Suicide and Suicide-related Behavior (K-COMPASS). We then validated the models in a test cohort. Our findings indicated that several factors significantly predicted suicide attempts in the models, including young age, suicidal ideation, previous suicidal attempts, anxiety, alcohol abuse, stress, and impulsivity. The area under the curve and positive predictive values were 0.941 and 0.484 after variable selection and 0.751 and 0.084 in the test cohort. The corresponding values for the penalized regression model were 0.943 and 0.524 in the original training cohort and 0.794 and 0.115 in the test cohort. The prediction model constructed through a prospective cohort study of the suicide high-risk group showed satisfactory accuracy even in the test cohort. The accuracy with penalized regression was greater than that with the "classical" logistic model.

Authors

  • Jeong Hun Yang
    Department of Psychiatry, Chungnam National University Sejong Hospital, Sejong, Republic of Korea; Department of Psychiatry, Seoul National University College of Medicine, Seoul, Republic of Korea.
  • Yuree Chung
    Department of Public Health Sciences, Seoul National University, Seoul, Republic of Korea.
  • Sang Jin Rhee
    Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea.
  • Kyungtaek Park
    Institute of Health and Environment, Seoul National University, Seoul, Republic of Korea.
  • Min Ji Kim
    Department of Radiology, Uijeongbu St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea.
  • Hyunju Lee
    College of Medicine, Hallym University, Chuncheon, Korea.
  • Yoojin Song
    Department of Psychiatry, Kangwon National University Hospital, Chuncheon, Republic of Korea.
  • Sang Yeol Lee
    Department of Psychiatry, Wonkwang University Hospital, Iksan, Republic of Korea.
  • Se-Hoon Shim
    Department of Psychiatry, Soon Chun Hyang University Cheonan Hospital, Soon Chun Hyang University, Cheonan, Republic of Korea.
  • Jung-Joon Moon
    Department of Psychiatry, Busan Paik Hospital, Inje University College of Medicine, Busan, Republic of Korea.
  • Seong-Jin Cho
    Department of Psychiatry, Gachon University Gil Medical Center, Incheon, Republic of Korea.
  • Shin Gyeom Kim
    Department of Neuropsychiatry, Soon Chun Hyang University Bucheon Hospital, Bucheon, Republic of Korea.
  • Min-Hyuk Kim
    Department of Psychiatry, Yonsei University Wonju College of Medicine, Wonju, Republic of Korea.
  • Jinhee Lee
    AI R & D Center, lululab Inc., Seoul, Republic of Korea.
  • Won Sub Kang
    Department of Psychiatry, Kyung Hee University Hospital, Seoul, Republic of Korea.
  • C Hyung Keun Park
    Department of Psychiatry, Asan Medical Center, Seoul, Republic of Korea.
  • Sungho Won
    Department of Public Health Sciences, Seoul National University (Y.L., S.W.).
  • Yong Min Ahn
    Institute of Human Behavioral Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea; Department of Psychiatry, Seoul National University Hospital, Seoul, Republic of Korea. Electronic address: aym@snu.ac.kr.