Evaluation framework to guide implementation of AI systems into healthcare settings.

Journal: BMJ health & care informatics
PMID: 34642177

Abstract

OBJECTIVES: To date, many artificial intelligence (AI) systems have been developed in healthcare, but adoption has been limited. This may be due to inappropriate or incomplete evaluation and a lack of internationally recognised AI standards on evaluation. To have confidence in the generalisability of AI systems in healthcare and to enable their integration into workflows, there is a need for a practical yet comprehensive instrument to assess the translational aspects of the available AI systems. Currently available evaluation frameworks for AI in healthcare focus on the reporting and regulatory aspects but have little guidance regarding assessment of the translational aspects of the AI systems like the functional, utility and ethical components.

Authors

  • Sandeep Reddy
    1 School of Medicine, Deakin University, Victoria 3220, Australia.
  • Wendy Rogers
    Department of Philosophy and Department of Clinical Medicine, Macquarie University, Balaclava Road, North Ryde, New South Wales, 2109, Australia. Electronic address: wendy.rogers@mq.edu.au.
  • Ville-Petteri Makinen
    South Australian Health and Medical Research Institute, Adelaide, South Australia, Australia.
  • Enrico Coiera
    1Australian Institute of Health Innovation, Macquarie University, Level 6 75 Talavera Rd, Sydney, NSW 2109 Australia.
  • Pieta Brown
    Orion Health, Auckland, Auckland, New Zealand.
  • Markus Wenzel
    Fraunhofer Heinrich Hertz Institute and Technische Universität Berlin, Berlin 10587, Germany.
  • Eva Weicken
    Fraunhofer Institute for Telecommunications Heinrich-Hertz-Institute HHI, Berlin, Germany.
  • Saba Ansari
    Deakin University Faculty of Health, Geelong, Victoria, Australia.
  • Piyush Mathur
    Department of General Anesthesiology, Anesthesiology Institute, Cleveland Clinic, 9500 Euclid Ave - E31, Cleveland, OH, 44195, USA.
  • Aaron Casey
    South Australian Health and Medical Research Institute, Adelaide, South Australia, Australia.
  • Blair Kelly
    Deakin University Faculty of Health, Geelong, Victoria, Australia.

Keywords

External Resources

Popular Topics
Recent Journals