Generative Artificial Intelligence in Pathology and Medicine: A Deeper Dive.

Journal: Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc
Published Date:

Abstract

This review article builds upon the introductory piece in our 7-part series, delving deeper into the transformative potential of generative artificial intelligence (Gen AI) in pathology and medicine. The article explores the applications of Gen AI models in pathology and medicine, including the use of custom chatbots for diagnostic report generation, synthetic image synthesis for training new models, data set augmentation, hypothetical scenario generation for educational purposes, and the use of multimodal along with multiagent models. This article also provides an overview of the common categories within Gen AI models, discussing open-source and closed-source models, as well as specific examples of popular models such as GPT-4, Llama, Mistral, DALL-E, Stable Diffusion, and their associated frameworks (eg, transformers, generative adversarial networks, diffusion-based neural networks), along with their limitations and challenges, especially within the medical domain. We also review common libraries and tools that are currently deemed necessary to build and integrate such models. Finally, we look to the future, discussing the potential impact of Gen AI on health care, including benefits, challenges, and concerns related to privacy, bias, ethics, application programming interface costs, and security measures.

Authors

  • Hooman H Rashidi
    Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania. Electronic address: rashidihh@upmc.edu.
  • Joshua Pantanowitz
    Michigan Center for Translational Pathology, University of Michigan, Ann Arbor, MI, USA.
  • Alireza Chamanzar
    Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania.
  • Brandon Fennell
    Department of Medicine, UCSF, School of Medicine, San Francisco, California.
  • Yanshan Wang
    Department of Health Sciences Research, Mayo Clinic, Rochester, MN, USA.
  • Rama R Gullapalli
    Departments of Pathology and Chemical and Biological Engineering, University of New Mexico, Albuquerque, New Mexico.
  • Ahmad Tafti
    Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania; Department of Health Information Management, University of Pittsburgh, Pittsburgh, Pennsylvania.
  • Mustafa Deebajah
    Pathology & Laboratory Medicine Institute, Cleveland Clinic, Cleveland, Ohio.
  • Samer Albahra
    Pathology & Laboratory Medicine Institute, Cleveland Clinic, Cleveland, Ohio.
  • Eric Glassy
    Affiliated Pathologists Medical Group, California.
  • Matthew G Hanna
    Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania.
  • Liron Pantanowitz
    Department of Pathology, University of Michigan, Ann Arbor, MI, USA.