Framework for Classifying Explainable Artificial Intelligence (XAI) Algorithms in Clinical Medicine.

Journal: Online journal of public health informatics
Published Date:

Abstract

Artificial intelligence (AI) applied to medicine offers immense promise, in addition to safety and regulatory concerns. Traditional AI produces a core algorithm result, typically without a measure of statistical confidence or an explanation of its biological-theoretical basis. Efforts are underway to develop explainable AI (XAI) algorithms that not only produce a result but also an explanation to support that result. Here we present a framework for classifying XAI algorithms applied to clinical medicine: An algorithm's clinical scope is defined by whether the core algorithm output leads to observations (eg, tests, imaging, clinical evaluation), interventions (eg, procedures, medications), diagnoses, and prognostication. Explanations are classified by whether they provide empiric statistical information, association with a historical population or populations, or association with an established disease mechanism or mechanisms. XAI implementations can be classified based on whether algorithm training and validation took into account the actions of health care providers in response to the insights and explanations provided or whether training was performed using only the core algorithm output as the end point. Finally, communication modalities used to convey an XAI explanation can be used to classify algorithms and may affect clinical outcomes. This framework can be used when designing, evaluating, and comparing XAI algorithms applied to medicine.

Authors

  • Thomas Gniadek
    Department of Pathology and Laboratory Medicine NorthShore University Health System Evanston, IL United States.
  • Jason Kang
    Department of Pathology and Laboratory Medicine NorthShore University Health System Evanston, IL United States.
  • Talent Theparee
    Department of Pathology and Laboratory Medicine NorthShore University Health System Evanston, IL United States.
  • Jacob Krive
    Department of Biomedical and Health Information Sciences University of Illinois at Chicago Chicago, IL United States.

Keywords

No keywords available for this article.