Statistics of Generative Artificial Intelligence and Nongenerative Predictive Analytics Machine Learning in Medicine.

Journal: Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc
Published Date:

Abstract

The rapidly evolving landscape of artificial intelligence (AI) and machine learning (ML) in medicine has prompted medical professionals to increasingly familiarize themselves with related topics. This also demands grasping the underlying statistical principles that govern their design, validation, and reproducibility. Uniquely, the practice of pathology and medicine produces vast amount of data that can be exploited by AI/ML. The emergence of generative AI, especially in the area of large language models and multimodal frameworks, represents approaches that are starting to transform medicine. Fundamentally, generative and traditional (eg, nongenerative predictive analytics) ML techniques rely on certain common statistical measures to function. However, unique to generative AI are metrics such as, but not limited to, perplexity and BiLingual Evaluation Understudy score that provide a means to determine the quality of generated samples that are typically unfamiliar to most medical practitioners. In contrast, nongenerative predictive analytics ML often uses more familiar metrics tailored to specific tasks as seen in the typical classification (ie, confusion metrics measures, such as accuracy, sensitivity, F1 score, and receiver operating characteristic area under the curve) or regression studies (ie, root mean square error and R). To this end, the goal of this review article (as part 4 of our AI review series) is to provide an overview and a comparative measure of statistical measures and methodologies used in both generative AI and traditional (ie, nongenerative predictive analytics) ML fields along with their strengths and known limitations. By understanding their similarities and differences along with their respective applications, we will become better stewards of this transformative space, which ultimately enables us to better address our current and future needs and challenges in a more responsible and scientifically sound manner.

Authors

  • Hooman H Rashidi
    Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania. Electronic address: rashidihh@upmc.edu.
  • Bo Hu
    Department of Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan, Hubei, China.
  • Joshua Pantanowitz
    Michigan Center for Translational Pathology, University of Michigan, Ann Arbor, MI, USA.
  • Nam Tran
    Division of Reproductive Endocrinology and Infertility, Department of Obstetrics, Gynecology and Reproductive Sciences, University of California San Francisco, San Francisco, California.
  • Silvia Liu
    Department of Pathology, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania; High Throughput Genome Center, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania; Pittsburgh Liver Research Center, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania.
  • Alireza Chamanzar
    Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania.
  • Mert Gur
    Department of Computational and Systems Biology, School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania; Department of Mechanical Engineering, Istanbul Technical University, Istanbul, Turkey.
  • Chung-Chou H Chang
    Departments of Biostatistics.
  • Yanshan Wang
    Department of Health Sciences Research, Mayo Clinic, Rochester, MN, USA.
  • Ahmad Tafti
    Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania; Department of Health Information Management, University of Pittsburgh, Pittsburgh, Pennsylvania.
  • Liron Pantanowitz
    Department of Pathology, University of Michigan, Ann Arbor, MI, USA.
  • Matthew G Hanna
    Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania.