Development and validation of a practical machine-learning triage algorithm for the detection of patients in need of critical care in the emergency department.

Journal: Scientific reports
PMID:

Abstract

Identifying critically ill patients is a key challenge in emergency department (ED) triage. Mis-triage errors are still widespread in triage systems around the world. Here, we present a machine learning system (MLS) to assist ED triage officers better recognize critically ill patients and provide a text-based explanation of the MLS recommendation. To derive the MLS, an existing dataset of 22,272 patient encounters from 2012 to 2019 from our institution's electronic emergency triage system (EETS) was used for algorithm training and validation. The area under the receiver operating characteristic curve (AUC) was 0.875 ± 0.006 (CI:95%) in retrospective dataset using fivefold cross validation, higher than that of reference model (0.843 ± 0.005 (CI:95%)). In the prospective cohort study, compared to the traditional triage system's 1.2% mis-triage rate, the mis-triage rate in the MLS-assisted group was 0.9%. This MLS method with a real-time explanation for triage officers was able to lower the mis-triage rate of critically ill ED patients.

Authors

  • Yecheng Liu
    Emergency Department, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China.
  • Jiandong Gao
    Department of Electronic Engineering, Tsinghua University, Beijing, China.
  • Jihai Liu
    Emergency Department, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China.
  • Joseph Harold Walline
    Accident and Emergency Medicine Academic Unit, The Chinese University of Hong Kong, Prince of Wales Hospital, Shatin, Hong Kong, China.
  • Xiaoying Liu
    Department of Pathology and Laboratory Medicine, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire.
  • Ting Zhang
    Beijing Municipal Key Laboratory of Child Development and Nutriomics, Capital Institute of Pediatrics, Beijing 100020, China.
  • Yunyang Wu
    Department of Electronic Engineering, Tsinghua University, Beijing, China.
  • Ji Wu
    Department of Urology, Nanchong Central Hospital, Nanchong, Sichuan, China.
  • Huadong Zhu
    Emergency Department, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China. drzhuhd@sina.com.
  • Weiguo Zhu
    Department of General Medicine, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, China.