A Learnable Prior Improves Inverse Tumor Growth Modeling.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

Biophysical modeling, particularly involving partial differential equations (PDEs), offers significant potential for tailoring disease treatment protocols to individual patients. However, the inverse problem-solving aspect of these models presents a substantial challenge, either due to the high computational requirements of model-based approaches or the limited robustness of deep learning (DL) methods. We propose a novel framework that leverages the unique strengths of both approaches in a synergistic manner. Our method incorporates a DL ensemble for initial parameter estimation, facilitating efficient downstream evolutionary sampling initialized with this DL-based prior. We showcase the effectiveness of integrating a rapid deep-learning algorithm with a high-precision evolution strategy in estimating brain tumor cell concentrations from magnetic resonance images. The DL-Prior plays a pivotal role, significantly constraining the effective sampling-parameter space. This reduction results in a fivefold convergence acceleration and a Dice-score of 95%.

Authors

  • Jonas Weidner
    Institute for Artificial Intelligence and Informatics in Medicine, Klinikum rechts der Isar, Technical University of Munich, Ismaninger Str., 81675, Munich, Bavaria, Germany.
  • Ivan Ezhov
    Technical University of Munich, Department of Computer Science, Munich, Germany.
  • Michal Balcerak
    University of Zurich, Switzerland.
  • Marie-Christin Metz
    From the Departments of Radiology (S.C.F., A.S.D., G.C.F., M.R.M.) and Neuroradiology (D.S., M.E.H., M.R., M.C.M., B.W., B.J.S., J.S.K.), Klinikum Rechts der Isar, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany; Departments of Radiology (S.S.G., J.W.) and Neuroradiology (R.S., A.S.G.), University Hospital Munich (LMU), Munich, Germany; and German Cancer Consortium (DKTK), Partner Site Munich, and German Cancer Research Center (DKFZ), Heidelberg, Germany (B.W.).
  • Sergey Litvinov
  • Sebastian Kaltenbach
  • Leonhard Feiner
  • Laurin Lux
  • Florian Kofler
    Department of Computer Science, Institute for AI in Medicine, Technical University of Munich, Munich, Germany; Department of Diagnostic and Interventional Neuroradiology, School of Medicine, Technical University of Munich, Munich, Germany; TranslaTUM, Central Institute for Translational Cancer Research of the Technical University of Munich, Munich, Germany; Helmholtz AI, Helmholtz Munich, Neuherberg, Germany.
  • Jana Lipkova
    Department of Informatics, Technische Universität München, Munich, Germany.
  • Jonas Latz
  • Daniel Rueckert
    Biomedical Image Analysis (BioMedIA) Group, Department of Computing, Imperial College London, UK. Electronic address: d.rueckert@imperial.ac.uk.
  • Bjoern Menze
  • Benedikt Wiestler
    Department of Neuroradiology, Klinikum rechts der Isar, Technical University of Munich (TUM), Ismaninger Straße 22, 81675 Munich, Germany; Deutsches Konsortium für Translationale Krebsforschung (DKTK), Partner Site Munich, Germany.