VIBESegmentator: full body MRI segmentation for the NAKO and UK Biobank.

Journal: European radiology
Published Date:

Abstract

OBJECTIVES: To present a publicly available deep learning-based torso segmentation model that provides comprehensive voxel-wise coverage, including delineations that extend to the boundaries of anatomical compartments. MATERIALS AND METHODS: We extracted preliminary segmentations from TotalSegmentator, spine, and body composition models for magnetic resonance tomography (MR) images, then improved them iteratively and retrained an nnUNet model. Using a random retrospective subset of German National Cohort (NAKO), UK Biobank, internal MR and computed tomography (CT) data (Training: 2897 series from 626 subjects, 290 female; mean age 53 ± 16; 3-fold-cross validation (20% hold-out). Internal testing 36 series from 12 subjects, 6 male; mean age 60 ± 11), we segmented 71 structures in torso MR and 72 in CT images: 20 organs, 10 muscles, 19 vessels, 16 bones, ribs in CT, intervertebral discs, spinal cord, spinal canal and body composition (subcutaneous fat, unclassified muscles and visceral fat). For external validation, we used existing automatic organ segmentations, independent ground truth segmentations on gradient echo images, and the Amos data. We used non-parametric bootstrapping for confidence intervals and the Wilcoxon rank-sum test for computing statistical significance. RESULTS: We achieved an average Dice score of 0.90 ± 0.06 on our internal gradient echo test set, which included 71 semantic segmentation labels. Our model ties with the best model on Amos with a Dice of 0,81 ± 0.14, while having a larger field of view and a considerably higher number of structures included. CONCLUSION: Our work presents a publicly available full-torso segmentation model for MRI and CT images that classifies almost all subject voxels to date. KEY POINTS: Question No completed MRI segmentation model exists that delineates the true transition boundaries of the anatomical structures of bone and muscles. Findings We provide a simple-to-use model that automatically segments MRI images, that can be utilized as a backbone for computer-aided automatic analysis. Clinical relevance Our segmentation model enables accurate and detailed full-torso segmentation on MRI and CT, improving automated analysis in large-scale epidemiological studies and facilitating more precise body composition and organ assessments for clinical and research applications.

Authors

  • Robert Graf
    Institute for Neuroradiology, TUM University Hospital, School of Medicine and Health, Technical University of Munich (TUM), Munich, Germany; Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany.
  • Paul Platzek
    Department of Diagnostic and Interventional Neuroradiology, School of Medicine, TUM University Hospital Neuro-Kopf-Zentrum Ismaninger Str. 22, 81675, München, Germany.
  • Evamaria Olga Riedel
    Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany.
  • Constanze Ramschütz
    Department of Diagnostic and Interventional Neuroradiology, School of Medicine, TUM University Hospital Neuro-Kopf-Zentrum Ismaninger Str. 22, 81675, München, Germany.
  • Sophie Starck
    School of Computation, Information and Technology, Technical University of Munich, Germany; School of Medicine, Klinikum rechts der Isar, Technical University of Munich, Germany.
  • Hendrik K Möller
    Department of Diagnostic and Interventional Neuroradiology, School of Medicine, TUM University Hospital Neuro-Kopf-Zentrum Ismaninger Str. 22, 81675, München, Germany.
  • Matan Atad
    Institute for Neuroradiology, TUM University Hospital, School of Medicine and Health, Technical University of Munich (TUM), Munich, Germany; Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany. Electronic address: [email protected].
  • Henry Völzke
    Institute for Community Medicine, University Medicine Greifswald, Greifswald, Germany.
  • Robin Bülow
    Institute of Diagnostic Radiology and Neuroradiology, University of Greifswald, Germany.
  • Carsten Oliver Schmidt
    Institut für Community Medicine, Abteilung SHIP-KEF, University Medicine Greifswald, Walter Rathenau Str. 48, 5. Etage, 17475, Greifswald, Germany.
  • Julia Rüdebusch
    Institut für Community Medicine, Abteilung SHIP-KEF, University Medicine Greifswald, Walter Rathenau Str. 48, 5. Etage, 17475, Greifswald, Germany.
  • Matthias Jung
    Department of Electrical Engineering and Computer Science, University of Siegen, Hölderlinstr. 3, Siegen, Germany.
  • Marco Reisert
    Medical Physics, Department of Diagnostic and Interventional Radiology, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany.
  • Jakob Weiss
    Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
  • Maximilian T Löffler
    Department of Diagnostic and Interventional Neuroradiology, School of Medicine, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany.
  • Fabian Bamberg
    Department of Diagnostic and Interventional Radiology, University Medical Center Tübingen, Tübingen, Germany.
  • Benedikt Wiestler
    Department of Neuroradiology, Klinikum rechts der Isar, Technical University of Munich (TUM), Ismaninger Straße 22, 81675 Munich, Germany; Deutsches Konsortium für Translationale Krebsforschung (DKTK), Partner Site Munich, Germany.
  • Johannes C Paetzold
    ITERM Institute Helmholtz Zentrum Muenchen, Neuherberg, Germany.
  • Daniel Rueckert
    Biomedical Image Analysis (BioMedIA) Group, Department of Computing, Imperial College London, UK. Electronic address: [email protected].
  • Jan Stefan Kirschke
    Department of Diagnostic and Interventional Neuroradiology, School of Medicine, TUM University Hospital Neuro-Kopf-Zentrum Ismaninger Str. 22, 81675, München, Germany.

Keywords

No keywords available for this article.