Deep Learning-Based Femoral Cartilage Automatic Segmentation in Ultrasound Imaging for Guidance in Robotic Knee Arthroscopy.

Journal: Ultrasound in medicine & biology
Published Date:

Abstract

Knee arthroscopy is a minimally invasive surgery used in the treatment of intra-articular knee pathology which may cause unintended damage to femoral cartilage. An ultrasound (US)-guided autonomous robotic platform for knee arthroscopy can be envisioned to minimise these risks and possibly to improve surgical outcomes. The first necessary tool for reliable guidance during robotic surgeries was an automatic segmentation algorithm to outline the regions at risk. In this work, we studied the feasibility of using a state-of-the-art deep neural network (UNet) to automatically segment femoral cartilage imaged with dynamic volumetric US (at the refresh rate of 1 Hz), under simulated surgical conditions. Six volunteers were scanned which resulted in the extraction of 18278 2-D US images from 35 dynamic 3-D US scans, and these were manually labelled. The UNet was evaluated using a five-fold cross-validation with an average of 15531 training and 3124 testing labelled images per fold. An intra-observer study was performed to assess intra-observer variability due to inherent US physical properties. To account for this variability, a novel metric concept named Dice coefficient with boundary uncertainty (DSC) was proposed and used to test the algorithm. The algorithm performed comparably to an experienced orthopaedic surgeon, with DSC of 0.87. The proposed UNet has the potential to localise femoral cartilage in robotic knee arthroscopy with clinical accuracy.

Authors

  • M Antico
    Institute of Health & Biomedical Innovation, Queensland University of Technology, Brisbane, Queensland, Australia; School of Chemistry, Physics and Mechanical Engineering, Queensland University of Technology, Brisbane, Queensland, Australia.
  • F Sasazawa
    Department of Orthopaedic Surgery, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Sapporo, 060-8638, Japan.
  • M Dunnhofer
    Department of Mathematics, Computer Science and Physics, University of Udine, Udine, Italy.
  • S M Camps
    Faculty of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands; Oncology Solutions Department, Philips Research, Eindhoven, The Netherlands.
  • A T Jaiprakash
    Institute of Health & Biomedical Innovation, Queensland University of Technology, Brisbane, QLD 4059, Australia; School of Electrical Engineering, Computer Science, Science and Engineering Faculty, Queensland 16 University of Technology, Brisbane, QLD 4000, Australia.
  • A K Pandey
    Department of Veterinary Gynaecology and Obstetrics, Teaching Veterinary Clinical Complex, College of Veterinary Sciences, Lala Lajpat Rai University of Veterinary and Animal Sciences, Hisar - 125 004, Haryana, India.
  • R Crawford
    School of Chemistry, Physics and Mechanical Engineering, Science and Engineering Faculty, Queensland University of Technology, Brisbane, QLD 4000, Australia; Institute of Health & Biomedical Innovation, Queensland University of Technology, Brisbane, QLD 4059, Australia.
  • G Carneiro
    Australian Centre of Visual Technologies, The University of Adelaide, Adelaide, Australia.
  • D Fontanarosa
    School of Clinical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia; Institute of Health & Biomedical Innovation, Queensland University of Technology, Brisbane, Queensland, Australia. Electronic address: d3.fontanarosa@qut.edu.au.