Synthetic data accelerates the development of generalizable learning-based algorithms for X-ray image analysis.

Journal: Nature machine intelligence
Published Date: Mar 20, 2023

Abstract

Artificial intelligence (AI) now enables automated interpretation of medical images. However, AI's potential use for interventional image analysis remains largely untapped. This is because the post hoc analysis of data collected during live procedures has fundamental and practical limitations, including ethical considerations, expense, scalability, data integrity and a lack of ground truth. Here we demonstrate that creating realistic simulated images from human models is a viable alternative and complement to large-scale in situ data collection. We show that training AI image analysis models on realistically synthesized data, combined with contemporary domain generalization techniques, results in machine learning models that on real data perform comparably to models trained on a precisely matched real data training set. We find that our model transfer paradigm for X-ray image analysis, which we refer to as SyntheX, can even outperform real-data-trained models due to the effectiveness of training on a larger dataset. SyntheX provides an opportunity to markedly accelerate the conception, design and evaluation of X-ray-based intelligent systems. In addition, SyntheX provides the opportunity to test novel instrumentation, design complementary surgical approaches, and envision novel techniques that improve outcomes, save time or mitigate human error, free from the ethical and practical considerations of live human data collection.

Authors

  • Cong Gao
    State Key Laboratory of Food Science and Technology, Jiangnan University, 1800 Lihu Road, Wuxi, 214122, Jiangsu, China.
  • Benjamin D Killeen
    Johns Hopkins University, Baltimore, MD, USA.
  • Yicheng Hu
    Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA.
  • Robert B Grupp
    Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA.
  • Russell H Taylor
    Johns Hopkins University, Baltimore, MD, USA.
  • Mehran Armand
    Johns Hopkins University, Baltimore, MD, USA.
  • Mathias Unberath
    Johns Hopkins University, Baltimore, MD, USA.

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals