A practical guide to the development and deployment of deep learning models for the orthopedic surgeon: part II.

Journal: Knee surgery, sports traumatology, arthroscopy : official journal of the ESSKA
Published Date:

Abstract

Deep learning has the potential to be one of the most transformative technologies to impact orthopedic surgery. Substantial innovation in this area has occurred over the past 5 years, but clinically meaningful advancements remain limited by a disconnect between clinical and technical experts. That is, it is likely that few orthopedic surgeons possess both the clinical knowledge necessary to identify orthopedic problems, and the technical knowledge needed to implement deep learning-based solutions. To maximize the utilization of rapidly advancing technologies derived from deep learning models, orthopedic surgeons should understand the steps needed to design, organize, implement, and evaluate a deep learning project and its workflow. Equipping surgeons with this knowledge is the objective of this three-part editorial review. Part I described the processes involved in defining the problem, team building, data acquisition, curation, labeling, and establishing the ground truth. Building on that, this review (Part II) provides guidance on pre-processing and augmenting the data, making use of open-source libraries/toolkits, and selecting the required hardware to implement the pipeline. Special considerations regarding model training and evaluation unique to deep learning models relative to "shallow" machine learning models are also reviewed. Finally, guidance pertaining to the clinical deployment of deep learning models in the real world is provided. As in Part I, the focus is on applications of deep learning for computer vision and imaging.

Authors

  • Jacob F Oeding
    School of Medicine, Mayo Clinic Alix School of Medicine Rochester Minnesota USA.
  • Riley J Williams
    Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, New York, U.S.A.
  • Christopher L Camp
    Department of Orthopedic Surgery, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA.
  • Joaquin Sanchez-Sotelo
    Department of Orthopedic Surgery, Mayo Clinic, Rochester, MN, USA.
  • Bryan T Kelly
    Sports Medicine - Hip Preservation Service, Hospital for Special Surgery, New York, New York, USA.
  • Danyal H Nawabi
    Sports Medicine - Hip Preservation Service, Hospital for Special Surgery, New York, New York, USA.
  • Jón Karlsson
    Orthopaedic Research Department, Göteborg University, Göteborg, SE, Sweden.
  • Andrew D Pearle
    Hospital for Special Surgery, New York, NY; Weill Cornell Medical College, New York, NY.
  • R Kyle Martin
    Department of Orthopaedic Surgery, University of Minnesota, Minneapolis, Minnesota, USA rkylemmartin@gmail.com.
  • Seong J Jang
    Department of Orthopaedic Surgery, Adult Reconstruction and Joint Replacement Service, New York, New York, USA.
  • Ayoosh Pareek
    Department of Orthopaedic Surgery and Sports Medicine, Mayo Clinic, Rochester, Minnesota, USA.