Validation of musculoskeletal segmentation model with uncertainty estimation for bone and muscle assessment in hip-to-knee clinical CT images.

Journal: Scientific reports
PMID:

Abstract

Deep learning-based image segmentation has allowed for the fully automated, accurate, and rapid analysis of musculoskeletal (MSK) structures from medical images. However, current approaches were either applied only to 2D cross-sectional images, addressed few structures, or were validated on small datasets, which limit the application in large-scale databases. This study aimed to validate an improved deep learning model for volumetric MSK segmentation of the hip and thigh with uncertainty estimation from clinical computed tomography (CT) images. Databases of CT images from multiple manufacturers/scanners, disease status, and patient positioning were used. The segmentation accuracy, and accuracy in estimating the structures volume and density, i.e., mean HU, were evaluated. An approach for segmentation failure detection based on predictive uncertainty was also investigated. The model has improved all segmentation accuracy and structure volume/density evaluation metrics compared to a shallower baseline model with a smaller training database (N = 20). The predictive uncertainty yielded large areas under the receiver operating characteristic (AUROC) curves (AUROCs ≥ .95) in detecting inaccurate and failed segmentations. Furthermore, the study has shown an impact of the disease severity status on the model's predictive uncertainties when applied to a large-scale database. The high segmentation and muscle volume/density estimation accuracy and the high accuracy in failure detection based on the predictive uncertainty exhibited the model's reliability for analyzing individual MSK structures in large-scale CT databases.

Authors

  • Mazen Soufi
    Division of Information Science, Graduate School of Science and Technology, Nara Institute of Science and Technology, 8916-5, Takayama-cho, Ikoma, Nara, Japan.
  • Yoshito Otake
  • Makoto Iwasa
    Department of Orthopedic Surgery, Graduate School of Medicine, Osaka University, 2-2 Yamadaoka, Suita, Osaka, 565-0871, Japan.
  • Keisuke Uemura
    Division of Information Science, Graduate School of Science and Technology, Nara Institute of Science and Technology, Ikoma, Nara, Japan. keisuke-uemura@is.naist.jp.
  • Tomoki Hakotani
    Division of Information Science, Graduate School of Science and Technology, Nara Institute of Science and Technology, 8916-5 Takayama-cho, Ikoma, Nara, 630-0192, Japan.
  • Masahiro Hashimoto
    Department of Radiology, Keio University School of Medicine, Tokyo, Japan. m.hashimoto@rad.med.keio.ac.jp.
  • Yoshitake Yamada
    Department of Radiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan. Electronic address: yamada@rad.med.keio.ac.jp.
  • Minoru Yamada
    Department of Radiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan.
  • Yoichi Yokoyama
    Department of Radiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan.
  • Masahiro Jinzaki
    Department of Radiology, Keio University School of Medicine, Tokyo, Japan.
  • Suzushi Kusano
    Hitachi Health Care Center, Hitachi Ltd., 4-3-16 Ose, Hitachi, 307-0076, Japan.
  • Masaki Takao
  • Seiji Okada
    Department of Orthopaedic Surgery, Osaka University Graduate School of Medicine, Suita, Japan.
  • Nobuhiko Sugano
  • Yoshinobu Sato
    Graduate School of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama-cho, Ikoma, Nara 630-0192, Japan. Electronic address: yoshi@is.naist.jp.