Automated detection of critical findings in multi-parametric brain MRI using a system of 3D neural networks.

Journal: Scientific reports
Published Date:

Abstract

With the rapid growth and increasing use of brain MRI, there is an interest in automated image classification to aid human interpretation and improve workflow. We aimed to train a deep convolutional neural network and assess its performance in identifying abnormal brain MRIs and critical intracranial findings including acute infarction, acute hemorrhage and mass effect. A total of 13,215 clinical brain MRI studies were categorized to training (74%), validation (9%), internal testing (8%) and external testing (8%) datasets. Up to eight contrasts were included from each brain MRI and each image volume was reformatted to common resolution to accommodate for differences between scanners. Following reviewing the radiology reports, three neuroradiologists assigned each study to abnormal vs normal, and identified three critical findings including acute infarction, acute hemorrhage, and mass effect. A deep convolutional neural network was constructed by a combination of localization feature extraction (LFE) modules and global classifiers to identify the presence of 4 variables in brain MRIs including abnormal, acute infarction, acute hemorrhage and mass effect. Training, validation and testing sets were randomly defined on a patient basis. Training was performed on 9845 studies using balanced sampling to address class imbalance. Receiver operating characteristic (ROC) analysis was performed. The ROC analysis of our models for 1050 studies within our internal test data showed AUC/sensitivity/specificity of 0.91/83%/86% for normal versus abnormal brain MRI, 0.95/92%/88% for acute infarction, 0.90/89%/81% for acute hemorrhage, and 0.93/93%/85% for mass effect. For 1072 studies within our external test data, it showed AUC/sensitivity/specificity of 0.88/80%/80% for normal versus abnormal brain MRI, 0.97/90%/97% for acute infarction, 0.83/72%/88% for acute hemorrhage, and 0.87/79%/81% for mass effect. Our proposed deep convolutional network can accurately identify abnormal and critical intracranial findings on individual brain MRIs, while addressing the fact that some MR contrasts might not be available in individual studies.

Authors

  • Kambiz Nael
    Department of Radiology, University of California, Los Angeles, Los Angeles, CA, USA.
  • Eli Gibson
    Wellcome / EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, UK; Centre for Medical Image Computing (CMIC), Departments of Medical Physics & Biomedical Engineering and Computer Science, University College London, UK.
  • Chen Yang
    Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China.
  • Pascal Ceccaldi
    Digital Technology and Innovation, Siemens Healthineers, Princeton, USA.
  • Youngjin Yoo
    Digital Technology and Innovation, Siemens Healthineers, Princeton, USA.
  • Jyotipriya Das
    Digital Technology and Innovation, Siemens Healthineers, Princeton, USA.
  • Amish Doshi
    Department of Radiology, Icahn School of Medicine at Mount Sinai, 1 Gustave L. Levy Place, New York, NY 10029, USA.
  • Bogdan Georgescu
  • Nirmal Janardhanan
    Digital Technology and Innovation, Siemens Healthineers, Princeton, USA.
  • Benjamin Odry
    AI for Clinical Analytics, Covera Health, New York, NY, USA.
  • Mariappan Nadar
    Digital Technology and Innovation, Siemens Healthineers, Princeton, USA.
  • Michael Bush
    Magnetic Resonance, Siemens Healthineers, New York, USA.
  • Thomas J Re
    Digital Technology and Innovation, Siemens Healthineers, Princeton, USA.
  • Stefan Huwer
    Magnetic Resonance, Siemens Healthineers, Erlangen, Germany.
  • Sonal Josan
    Digital Health, Siemens Healthineers, Erlangen, Germany.
  • Heinrich von Busch
    Digital Health, Siemens Healthineers, Erlangen, Germany.
  • Heiko Meyer
    Siemens Healthcare, Application Development, Erlangen, Germany.
  • David Mendelson
    Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, USA.
  • Burton P Drayer
    Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, USA.
  • Dorin Comaniciu
  • Zahi A Fayad
    Translational and Molecular Imaging Institute (TMII), Icahn School of Medicine at Mount Sinai, Department of Radiology, NY, USA.