Mixed Reality and Artificial Intelligence: A Holistic Approach to Multimodal Visualization and Extended Interaction in Knee Osteotomy.

Journal: IEEE journal of translational engineering in health and medicine
PMID:

Abstract

OBJECTIVE: Recent advancements in augmented reality led to planning and navigation systems for orthopedic surgery. However little is known about mixed reality (MR) in orthopedics. Furthermore, artificial intelligence (AI) has the potential to boost the capabilities of MR by enabling automation and personalization. The purpose of this work is to assess Holoknee prototype, based on AI and MR for multimodal data visualization and surgical planning in knee osteotomy, developed to run on the HoloLens 2 headset.

Authors

  • Andrea Moglia
    Department of ElectronicsInformation and BioengineeringPolitecnico di Milano 20133 Milan Italy.
  • Luca Marsilio
    Department of ElectronicsInformation and BioengineeringPolitecnico di Milano 20133 Milan Italy.
  • Matteo Rossi
    Department of ElectronicsInformation and BioengineeringPolitecnico di Milano 20133 Milan Italy.
  • Maria Pinelli
    Department of Management, Economics and Industrial EngineeringPolitecnico di Milano 20133 Milan Italy.
  • Emanuele Lettieri
    Department of Management, Economics and Industrial EngineeringPolitecnico di Milano 20133 Milan Italy.
  • Luca Mainardi
    Department of ElectronicsInformation and BioengineeringPolitecnico di Milano 20133 Milan Italy.
  • Alfonso Manzotti
    Hospital ASST FBF-Sacco 20157 Milan Italy.
  • Pietro Cerveri
    Department of ElectronicsInformation and BioengineeringPolitecnico di Milano 20133 Milan Italy.