Prospective validation of an AI algorithm to identify adult-onset type 1 diabetes misclassification: protocol for a non-interventional multicentre study.

Journal: BMJ open
Published Date:

Abstract

INTRODUCTION: Adult-onset type 1 diabetes (T1D) is often misclassified as type 2 diabetes (T2D), resulting in delayed treatment, missed opportunities for referrals to specialists and increased risk of complications including diabetic ketoacidosis. An electronic medical record (EMR)-based algorithm-originally trained on a large national EMR dataset to identify likely misclassified adult-onset T1D cases-was tested and retrained on a health information exchange (HIE) dataset from HealthShare Exchange (HSX). Promising results were achieved on historical data, particularly when using the retrained algorithm. However, its prospective validation is essential to more reliably assess its clinical utility and real-world precision in flagging high-risk patients for clinician review. METHODS AND ANALYSIS: This is a prospective, multicentre, non-interventional cohort study in two HSX-member healthcare organisations (HCOs) in southeastern Pennsylvania. At the onset of the study, all adult T2D patients are scored by the algorithm analysing HIE data on relevant predictors found in the 24-month lookback period. Patients meeting a prespecified score threshold estimated in retrospective testing to yield 10% recall will be presented to designated endocrinology or primary care providers for structured chart review, attribution confirmation and guideline-concordant follow-up (including autoantibody testing where appropriate). The primary endpoint is positive predictive value for confirmed adult-onset T1D among flagged patients. Secondary endpoints characterise operational cascade metrics (attribution, provider recommendation, test ordering/results and diagnosis updates) along with 95% CIs. Exploratory endpoints will assess provider adoption, interpretability and workflow integration via structured provider interviews. ETHICS AND DISSEMINATION: This study was reviewed and approved by Advarra Institutional Review Board (protocol Pro00075945). The Institutional Review Board waived patient informed consent and granted a full waiver of HIPAA authorisation for patient records, while providers were required to provide written informed consent. HSX data were accessed and shared under its member-defined use cases. Findings will be disseminated via peer-reviewed publications and conference presentations. Reporting will follow Strengthening the Reporting of Observational Studies in Epidemiology guidance for cohort studies.

Authors

Keywords

No keywords available for this article.