Patient-specific uncertainty calibration of deep learning-based autosegmentation networks for adaptive MRI-guided lung radiotherapy.

Journal: Physics in medicine and biology
PMID:

Abstract

Uncertainty assessment of deep learning autosegmentation (DLAS) models can support contour corrections in adaptive radiotherapy (ART), e.g. by utilizing Monte Carlo Dropout (MCD) uncertainty maps. However, poorly calibrated uncertainties at the patient level often render these clinically nonviable. We evaluated population-based and patient-specific DLAS accuracy and uncertainty calibration and propose a patient-specific post-training uncertainty calibration method for DLAS in ART.The study included 122 lung cancer patients treated with a low-field MR-linac (80/19/23 training/validation/test cases). Ten single-label 3D-U-Net population-based baseline models (BM) were trained with dropout using planning MRIs (pMRIs) and contours for nine organs-at-riks (OARs) and gross tumor volumes (GTVs). Patient-specific models (PS) were created by fine-tuning BMs with each test patient's pMRI. Model uncertainty was assessed with MCD, averaged into probability maps. Uncertainty calibration was evaluated with reliability diagrams and expected calibration error (ECE). A proposed post-training calibration method rescaled MCD probabilities for fraction images in BM (calBM) and PS (calPS) after fitting reliability diagrams from pMRIs. All models were evaluated on fraction images using Dice similarity coefficient (DSC), 95th percentile Hausdorff distance (HD95) and ECE. Metrics were compared among models for all OARs combined ( = 163), and the GTV ( = 23), using Friedman and posthoc-Nemenyi tests ( = 0.05).For the OARs, patient-specific fine-tuning significantly ( < 0.001) increased median DSC from 0.78 (BM) to 0.86 (PS) and reduced HD95 from 14 mm (BM) to 6.0 mm (PS). Uncertainty calibration achieved substantial reductions in ECE, from 0.25 (BM) to 0.091 (calBM) and 0.22 (PS) to 0.11 (calPS) ( < 0.001), without significantly affecting DSC or HD95 ( > 0.05). For the GTV, BM performance was poor (DSC = 0.05) but significantly ( < 0.001) improved with PS training (DSC = 0.75) while uncertainty calibration reduced ECE from 0.22 (PS) to 0.15 (calPS) ( = 0.45).Post-training uncertainty calibration yields geometrically accurate DLAS models with well-calibrated uncertainty estimates, crucial for ART applications.

Authors

  • Moritz Rabe
    Department of Radiation Oncology, University Hospital, LMU Munich, Munich 81377, Germany.
  • Ettore F Meliadò
    Department of Radiology, University Medical Center Utrecht, Computational Imaging Group for MR diagnostics & therapy, Center for Image Sciences, Utrecht, The Netherlands.
  • Sebastian N Marschner
    Department of Radiation Oncology, University Hospital, LMU Munich, Marchioninistr. 15, 81377, Munich, Germany.
  • Claus Belka
    Department of Radiation Oncology, University Hospital, LMU Munich, Marchioninistr. 15, 81377, Munich, Germany.
  • Stefanie Corradini
    Department of Radiation Oncology, University Hospital, LMU Munich, Marchioninistr. 15, 81377, Munich, Germany.
  • Cornelis A T van den Berg
    Department of Radiation Oncology, University Medical Center Utrecht, Utrecht, The Netherlands.
  • Guillaume Landry
    Department of Medical Physics, Faculty of Physics, Ludwig-Maximilians-Universität München (LMU Munich), Garching bei München, 85748, Germany.
  • Christopher Kurz
    Department of Medical Physics, Faculty of Physics, Ludwig-Maximilians-Universität München (LMU Munich), Garching bei München, 85748, Germany.