Population-level individualized prospective prediction of opioid overdose using machine learning.

Journal: Molecular psychiatry
Published Date:

Abstract

The opioid overdose epidemic has rapidly expanded in North America, with rates accelerating during the COVID-19 pandemic. No existing study has demonstrated prospective opioid overdose at a population level. This study aimed to develop and validate a population-level individualized prospective prediction model of opioid overdose (OpOD) using machine learning (ML) and de-identified provincial administrative health data. The OpOD prediction model was based on a cohort of approximately 4 million people in 2017 to predict OpOD cases in 2018 and was subsequently tested on cohort data from 2018, 2019, and 2020 to predict OpOD cases in 2019, 2020, and 2021, respectively. The model's predictive performance, including balanced accuracy, sensitivity, specificity, and area under the Receiver Operating Characteristics Curve (AUC), was evaluated, achieving a balanced accuracy of 83.7, 81.6, and 85.0% in each respective year. The leading predictors for OpOD, which were derived from health care utilization variables documented by the Canadian Institute for Health Information (CIHI) and physician billing claims, were treatment encounters for drug or alcohol use, depression, neurotic/anxiety/obsessive-compulsive disorder, and superficial skin injury. The main contribution of our study is to demonstrate that ML-based individualized OpOD prediction using existing population-level data can provide accurate prediction of future OpOD cases in the whole population and may have the potential to inform targeted interventions and policy planning.

Authors

  • Yang S Liu
    Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada.
  • Derek V Pierce
    Department of Psychiatry, University of Alberta, Edmonton, AB, Canada.
  • Dan Metes
    Analytics and Performance Reporting Branch, Ministry of Health, Government of Alberta, Edmonton, AB, Canada.
  • Yipeng Song
    Department of Psychiatry, University of Alberta, Edmonton, Alberta, Canada.
  • Lawrence Kiyang
    Analytics and Performance Reporting Branch, Ministry of Health, Government of Alberta, Edmonton, AB, Canada.
  • Mengzhe Wang
    Analytics and Performance Reporting Branch, Ministry of Health, Government of Alberta, Edmonton, AB, Canada.
  • Kathryn Dong
    Department of Emergency Medicine, University of Alberta, Edmonton, AB, Canada.
  • Dean T Eurich
    School of Public Health, University of Alberta, Edmonton, AB, Canada.
  • Scott Patten
    Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada.
  • Russell Greiner
    Unity Health Toronto (Verma, Murray, Straus, Pou-Prom, Mamdani); Li Ka Shing Knowledge Institute of St. Michael's Hospital (Verma, Straus, Pou-Prom, Mamdani); Department of Medicine (Verma, Shojania, Straus, Mamdani) and Institute of Health Policy, Management, and Evaluation (Verma, Mamdani) and Department of Statistics (Murray), University of Toronto, Toronto, Ont.; University of Alberta (Greiner); Alberta Machine Intelligence Institute (Greiner), Edmonton, Alta.; Montreal Institute for Learning Algorithms (Cohen), Montréal, Que.; Centre for Quality Improvement and Patient Safety (Shojania), University of Toronto; Sunnybrook Health Sciences Centre (Shojania); Vector Institute (Ghassemi, Mamdani) and Department of Computer Science (Ghassemi); Leslie Dan Faculty of Pharmacy (Mamdani), University of Toronto, Toronto, Ont.; Department of Radiology, Stanford University (Cohen), Stanford, Calif.
  • Yanbo Zhang
    Department of Psychiatry, University of Alberta, Edmonton, Canada.
  • Jake Hayward
    University of Alberta, Faculty of Medicine and Dentistry, Department of Emergency Medicine, 750 University Terrace Building, 8303-112 Street NW, Edmonton T6G 2T4, Canada.
  • Andrew Greenshaw
    Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada.
  • Bo Cao
    Department of Psychiatry, University of Alberta, Edmonton, Canada.