Accessible cartilage tumor malignancy prediction via vision-language foundation model adaptation.

Journal: Skeletal radiology
Published Date:

Abstract

OBJECTIVE: To predict cartilage tumor malignancy from radiographic images combined with readily available non-imaging information based on a vision-language foundation model. MATERIALS AND METHODS: This single-institution study assembled a dataset of 3336 radiographs from 455 patients with enchondroma or chondrosarcoma that was assembled from two sources: (1) patients with histopathology-confirmed diagnoses of enchondroma or chondrosarcoma, and (2) patients with imaging-stable enchondroma without biopsy, confirmed through long-term imaging follow-up. An adapted vision-language foundation model based on the pre-trained CLIP (Contrastive Language-Image Pretraining) architecture was fine-tuned with our proposed Medical Knowledge Adapters and evaluated using 10-fold patient-level cross-validation to predict cartilage tumor malignancy from plain radiographs and demographic information. RESULTS AND CONCLUSION: Using radiographs alone, the model achieved an Areas Under the receiver operating characteristic Curve (AUC) of 0.91 ± 0.04. Incorporating demographics improved the AUC to 0.94 ± 0.02. Subgroup analysis demonstrated robust generalizability across tumor grades with an AUC of 0.91 ± 0.07 in distinguishing atypical cartilaginous tumors (ACT) previously known as low grade chondrosarcomas, and 0.95 ± 0.02 in differentiating high-grade chondrosarcomas from enchondromas. Within the clinically challenging extremity subgroup (enchondroma vs ACT/LGCS), the model achieved an AUC of 0.79 ± 0.14, reflecting diagnostic difficulty observed in clinical practice. This foundation model-based approach demonstrates strong performance using accessible data sources, offering a non-invasive, cost-efficient, and scalable solution for cartilage tumor assessment in musculoskeletal oncology.

Authors

  • Xingxin He
  • Zachary E Stewart
    Department of Radiology, Massachusetts General Hospital, Boston, MA, USA.
  • Marcos R Gonzalez
    Division of Orthopaedic Oncology, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.
  • Yin P Hung
    Department of Pathology, Massachusetts General Hospital, Boston, MA, USA.
  • Tara Shirin Ossiani
    Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, MA, USA.
  • Yung Hsin Chen
  • Joseph Oliver Werenski
    Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, MA, USA.
  • Ronald W Mercer
    Department of Radiology, Massachusetts General Hospital, Boston, MA, USA.
  • Zhaoye Zhou
    Department of Biomedical Engineering, University of Minnesota, Minneapolis, Minnesota, USA.
  • Kendall Brown
    Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, MA, USA.
  • Santiago A Lozano-Calderon
    Division of Orthopaedic Oncology, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.
  • Fang Liu
    The First Clinical Medical College of Gannan Medical University, Ganzhou 341000, Jiangxi Province, China.

Keywords

No keywords available for this article.