End-to-end reproducible AI pipelines in radiology using the cloud.

Journal: Nature communications
PMID:

Abstract

Artificial intelligence (AI) algorithms hold the potential to revolutionize radiology. However, a significant portion of the published literature lacks transparency and reproducibility, which hampers sustained progress toward clinical translation. Although several reporting guidelines have been proposed, identifying practical means to address these issues remains challenging. Here, we show the potential of cloud-based infrastructure for implementing and sharing transparent and reproducible AI-based radiology pipelines. We demonstrate end-to-end reproducibility from retrieving cloud-hosted data, through data pre-processing, deep learning inference, and post-processing, to the analysis and reporting of the final results. We successfully implement two distinct use cases, starting from recent literature on AI-based biomarkers for cancer imaging. Using cloud-hosted data and computing, we confirm the findings of these studies and extend the validation to previously unseen data for one of the use cases. Furthermore, we provide the community with transparent and easy-to-extend examples of pipelines impactful for the broader oncology field. Our approach demonstrates the potential of cloud resources for implementing, sharing, and using reproducible and transparent AI pipelines, which can accelerate the translation into clinical solutions.

Authors

  • Dennis Bontempi
    Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States.
  • Leonard Nuernberg
    Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
  • Suraj Pai
    Maastricht University Medical Centre, Netherlands.
  • Deepa Krishnaswamy
  • Vamsi Thiriveedhi
    Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
  • Ahmed Hosny
    Department of Radiation Oncology, Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
  • Raymond H Mak
    Department of Radiation Oncology, Brigham and Women's Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States.
  • Keyvan Farahani
    Image-Guided Interventions and Imaging Informatics, National Cancer Institute, National Institutes of Health, Rockville, Maryland, USA.
  • Ron Kikinis
    Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States.
  • Andrey Fedorov
    Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States.
  • Hugo J W L Aerts
    Department of Radiation Oncology, Brigham and Women's Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States.