SegmentAnyBone: A universal model that segments any bone at any location on MRI.

Journal: Medical image analysis
PMID:

Abstract

Magnetic Resonance Imaging (MRI) is pivotal in radiology, offering non-invasive and high-quality insights into the human body. Precise segmentation of the MRIs into different organs and tissues would be very beneficial as it would allow more accurate measurements, which are essential for accurate diagnosis and effective treatment planning. Specifically, segmenting bones in MRI would allow for more quantitative assessments of musculoskeletal conditions, while such assessments are largely absent in current radiological practice. The difficulty of bone MRI segmentation is illustrated by the fact that limited algorithms are publicly available, and those contained in the literature typically address a specific anatomic area. In our study, we propose a versatile, publicly available deep learning model for bone segmentation in MRI at multiple standard MRI locations. The proposed model can operate in two modes: fully automated segmentation and prompt-based segmentation. Our contributions include (1) collecting and annotating a new MRI dataset across various MRI protocols, encompassing 320 annotated volumes and more than 10k annotated slices across diverse anatomic regions; (2) investigating several standard network architectures and strategies for automated segmentation; (3) introducing SegmentAnyBone, an innovative foundation model-based approach that extends the Segment Anything Model (SAM); (4) comparative analysis of our algorithm and previous approaches; and (5) generalization analysis of our algorithm across different anatomical locations and MRI sequences, as well as three external datasets. We publicly release our model at Github Code.

Authors

  • Hanxue Gu
    Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina.
  • Roy Colglazier
    Department of Radiology, Duke, NC, 27703, USA.
  • Haoyu Dong
  • Jikai Zhang
    Department of Biostatistics and Bioinformatics (J.Z., R.H.), Duke University School of Medicine, Durham, NC.
  • Yaqian Chen
    Department of Electrical and Computer Engineering, Duke, NC, 27703, USA.
  • Zafer Yildiz
    Department of Radiology, Duke, NC, 27703, USA.
  • Yuwen Chen
    QPS Taiwan, Center of Toxicology and Preclinical Sciences, No. 103, Lane 169, Kangning Street, Xizhi District, New Taipei City 221, Taiwan.
  • Lin Li
    Department of Medicine III, LMU University Hospital, LMU Munich, Munich, Germany.
  • Jichen Yang
  • Jay Willhite
    Department of Radiology, Duke, NC, 27703, USA.
  • Alex M Meyer
    Department of Orthopaedics, Duke, NC, 27703, USA.
  • Brian Guo
    Department of Computer Science, Duke, NC, 27703, USA.
  • Yashvi Atul Shah
    Department of Radiology, Duke, NC, 27703, USA.
  • Emily Luo
    University School of Medicine, Duke, NC, 27703, USA.
  • Shipra Rajput
    Department of Radiology, Duke, NC, 27703, USA.
  • Sally Kuehn
    University School of Medicine, Duke, NC, 27703, USA.
  • Clark Bulleit
    University School of Medicine, Duke, NC, 27703, USA.
  • Kevin A Wu
    University School of Medicine, Duke, NC, 27703, USA.
  • Jisoo Lee
    Department of Radiology, Seoul National University College of Medicine, Seoul, Republic of Korea.
  • Brandon Ramirez
    Department of Electrical and Computer Engineering, Duke, NC, 27703, USA; Department of Computer Science, Duke, NC, 27703, USA.
  • Darui Lu
    Department of Electrical and Computer Engineering, Duke, NC, 27703, USA.
  • Jay M Levin
    Department of Orthopaedic Surgery, Duke University, Durham, NC, USA.
  • Maciej A Mazurowski
    Department of Radiology, Duke University School of Medicine, 2424 Erwin Road, Suite 302, Durham, NC, 27705, USA.