Artificial intelligence for severity triage based on conversations in an emergency department in Korea.

Journal: Scientific reports
PMID:

Abstract

In the fast-paced emergency departments, where crises unfold unpredictably, the systematic prioritization of critical patients based on a severity classification is vital for swift and effective treatment. This study aimed to enhance the quality of emergency services by automatically categorizing the severity levels of incoming patients using AI-powered natural language processing (NLP) algorithms to analyze conversations between medical staff and patients. The dataset comprised 1,028 transcripts of bedside conversations within emergency rooms. To verify the robustness of the models, we performed tenfold cross-validation. Based on the area under the receiver operating characteristic curve (AUROC) values, the support vector machine achieved the best performance among the term frequency-inverse document frequency-based conventional machine learning models with an AUROC of 0.764 (95% CI 0.019). Among the neural network models, multilayer perceptron performed with an AUROC of 0.759 (± 0.024). This research explored methods for automatically classifying patient severity using real-world conversations, including those with nonsensical and confused content. To achieve this, artificial intelligence algorithms that consider the frequency and order of words used in the conversation were employed alongside neural network models. Our findings have the potential to significantly contribute to alleviating overcrowding in emergency departments of hospitals, with future extensions involving highly efficient large language models. The results suggest that a fluid and immediate response to urgent situations, a reduction in patient waiting time, and effectively addressing the special circumstances of the emergency room environment can be achieved using this approach.

Authors

  • Jae Won Seo
    Department of Health Sciences and Technology, GAIHST, Gachon University, Incheon, 21999, Republic of Korea.
  • Sung-Joon Park
    Department of Computer Science, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656, Japan.
  • Young Jae Kim
    Department of Biomedical Engineering, College of Medicine, Gachon University, Gyeonggi-do, Republic of Korea.
  • Jung-Youn Kim
    Department of Emergency Medicine, Korea University College of Medicine, Seoul, 02841, Korea.
  • Kwang Gi Kim
    Department of Biomedical Engineering Branch, National Cancer Center, Gyeonggi-do, South Korea.
  • Young-Hoon Yoon
    Department of Emergency Medicine, Korea University College of Medicine, Seoul, 02841, Korea. yyh71346@naver.com.