3D/2D model-to-image registration by imitation learning for cardiac procedures.

Journal: International journal of computer assisted radiology and surgery
PMID:

Abstract

PURPOSE: In cardiac interventions, such as cardiac resynchronization therapy (CRT), image guidance can be enhanced by involving preoperative models. Multimodality 3D/2D registration for image guidance, however, remains a significant research challenge for fundamentally different image data, i.e., MR to X-ray. Registration methods must account for differences in intensity, contrast levels, resolution, dimensionality, field of view. Furthermore, same anatomical structures may not be visible in both modalities. Current approaches have focused on developing modality-specific solutions for individual clinical use cases, by introducing constraints, or identifying cross-modality information manually. Machine learning approaches have the potential to create more general registration platforms. However, training image to image methods would require large multimodal datasets and ground truth for each target application.

Authors

  • Daniel Toth
    Siemens Healthineers, Frimley, UK. daniel.toth@kcl.ac.uk.
  • Shun Miao
    Siemens Healthineers, Medical Imaging Technologies, Princeton, NJ, USA.
  • Tanja Kurzendorfer
    Siemens Healthineers, Forchheim, Germany.
  • Christopher A Rinaldi
    Division of Imaging Sciences and Biomedical Engineering, King's College London, London, United Kingdom.
  • Rui Liao
    Siemens Healthineers, Medical Imaging Technologies, Princeton, NJ, USA.
  • Tommaso Mansi
    Medical Imaging Technologies, Siemens Healthcare, Princeton, USA.
  • Kawal Rhode
    Division of Imaging Sciences and Biomedical Engineering, King's College London, UK.
  • Peter Mountney
    Siemens Healthineers, Medical Imaging Technologies, Princeton, NJ, USA.