Strategies for creation of data reserve and stress testing of medical AI products.

Journal: BMJ health & care informatics
PMID: 39632098

Abstract

With the fast development of artificial intelligence (AI) and its applications in medicine, it is often said that the time for intelligent medicine is arriving, if not already have arrived. While there is no doubt that AI-centred intelligent medicine will transform current healthcare, it is necessary to test and re-test medical AI (MAI) products before they are implemented in the real world. From the perspective of ensuring safety, accuracy and efficiency, it is imperative that MAIs undergo stress tests in a systematic and comprehensive manner where stress tests subject MAIs to workloads and environments beyond tests carried out by their developers. In such stress tests, potential bottlenecks or failures of MAIs may be identified and fed back to developers to optimise the products. To avoid bias and ensure fairness, stress tests should be prepared and administered by an independent body.

Authors

  • Huai Chen
    Department of Radiology, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, Guangdong 510120, China.
  • Yanmei Tie
    Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
  • Xinhua Cao
    Department of Radiology, Boston Children's Hospital, Boston, MA, USA.
  • Geoffrey S Young
    Departments of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA 02115, USA.
  • Xiaoyin Xu
    Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA. Electronic address: xxu@bwh.harvard.edu.

Keywords

External Resources

Popular Topics
Recent Journals