World of Forms: Deformable geometric templates for one-shot surface meshing in coronary CT angiography.

Journal: Medical image analysis
Published Date:

Abstract

Deep learning-based medical image segmentation and surface mesh generation typically involve a sequential pipeline from image to segmentation to meshes, often requiring large training datasets while making limited use of prior geometric knowledge. This may lead to topological inconsistencies and suboptimal performance in low-data regimes. To address these challenges, we propose a data-efficient deep learning method for direct 3D anatomical object surface meshing using geometric priors. Our approach employs a multi-resolution graph neural network that operates on a prior geometric template which is deformed to fit object boundaries of interest. We show how different templates may be used for the different surface meshing targets, and introduce a novel masked autoencoder pretraining strategy for 3D spherical data. The proposed method outperforms nnUNet in a one-shot setting for segmentation of the pericardium, left ventricle (LV) cavity and the LV myocardium. Similarly, the method outperforms other lumen segmentation operating on multi-planar reformatted images. Results further indicate that mesh quality is on par with or improves upon marching cubes post-processing of voxel mask predictions, while remaining flexible in the choice of mesh triangulation prior, thus paving the way for more accurate and topologically consistent 3D medical object surface meshing.

Authors

  • Rudolf L M van Herten
    Department of Biomedical Engineering and Physics, Amsterdam UMC, Meibergdreef 9, Amsterdam, 1105 AZ, The Netherlands; Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands; Amsterdam Cardiovascular Sciences, Amsterdam, The Netherlands. Electronic address: r.l.m.vanherten@amsterdamumc.nl.
  • Ioannis Lagogiannis
    Department of Biomedical Engineering and Physics, Amsterdam UMC, Meibergdreef 9, Amsterdam, 1105 AZ, The Netherlands; Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands; Amsterdam Cardiovascular Sciences, Amsterdam, The Netherlands.
  • Jelmer M Wolterink
    Department of Biomedical Engineering and Physics, Amsterdam University Medical Center, University of Amsterdam, Amsterdam, Netherlands.
  • Steffen Bruns
    Department of Biomedical Engineering and Physics, Amsterdam UMC - location AMC, University of Amsterdam, Amsterdam, 1105 AZ, Netherlands.
  • Eva R Meulendijks
    Department of Radiology and Nuclear Medicine, Amsterdam UMC, Meibergdreef 9, Amsterdam, 1105 AZ, The Netherlands.
  • Damini Dey
    Departments of Imaging and Medicine, and Cedars-Sinai Heart Institute, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Taper A238, Los Angeles, CA, 90048, USA.
  • Joris R de Groot
    Heart Center, Department of Clinical and Experimental Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam UMC, location AMC, The Netherlands (R.E.K., W.v.d.S., L.V.A.B., T.F.B., A.-F.B.E.Q., L.S., J.G.P.T., J.R.d.G., K.M.K., A.d.W., A.A.M.W., L.R.A.O.N.).
  • José P Henriques
    Heart Centre, Academic Medical Centre, Amsterdam Cardiovascular Sciences, University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, the Netherlands. Electronic address: j.p.henriques@amsterdamumc.nl.
  • R Nils Planken
    Departments of Radiology and Nuclear Medicine (C.P.S.B., A.J.N., P.v.O., R.N.P.) and Cardiology (S.M.B.), Amsterdam University Medical Centers, Location Academic Medical Center, Meibergdreef 9, 1105 AZ Amsterdam, the Netherlands; Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands (J.J.M.W.); Department of Research and Development, Pie Medical Imaging BV, Maastricht, the Netherlands (J.P.A.); and Departments of Cardiology (G.P.B., S.A.J.C.) and Radiology (T.L.), University Medical Center Utrecht, Utrecht, the Netherlands.
  • Simone Saitta
    Department of Electronics Information and Bioengineering, Politecnico Di Milano, Milan, Italy.
  • Ivana Išgum
    Department of Biomedical Engineering and Physics, Amsterdam University Medical Center, University of Amsterdam, Amsterdam, Netherlands.