Intelligent control of robotic X-ray devices using a language-promptable digital twin.

Journal: International journal of computer assisted radiology and surgery
Published Date: Apr 9, 2025

Abstract

PURPOSE: Natural language offers a convenient, flexible interface for controlling robotic C-arm X-ray systems, making advanced functionality and controls easily accessible.Please confirm if the author names are presented accurately and in the correct sequence (given name, middle name/initial, family name). Author 1 Given name: [Benjamin D.] Last name [Killeen]. Also, kindly confirm the details in the metadata are correct. However, enabling language interfaces requires specialized artificial intelligence (AI) models that interpret X-ray images to create a semantic representation for language-based reasoning. The fixed outputs of such AI models fundamentally limits the functionality of language controls that users may access. Incorporating flexible and language-aligned AI models that can be prompted through language control facilitates more flexible interfaces for a much wider variety of tasks and procedures.

Authors

  • Benjamin D Killeen
    Johns Hopkins University, Baltimore, MD, USA.
  • Anushri Suresh
    Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, 21218, MD, USA.
  • Catalina Gomez
  • Blanca Íñigo
    Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, 21218, MD, USA.
  • Christopher Bailey
    Division of Vascular and Interventional Radiology, Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD.
  • Mathias Unberath
    Johns Hopkins University, Baltimore, MD, USA.

Keywords

External Resources

Popular Topics
Recent Journals