The Accuracy and Capability of Artificial Intelligence Solutions in Health Care Examinations and Certificates: Systematic Review and Meta-Analysis.

Journal: Journal of medical Internet research
Published Date:

Abstract

BACKGROUND: Large language models (LLMs) have dominated public interest due to their apparent capability to accurately replicate learned knowledge in narrative text. However, there is a lack of clarity about the accuracy and capability standards of LLMs in health care examinations.

Authors

  • William J Waldock
    Imperial College London, London, United Kingdom.
  • Joe Zhang
    Department of Adult Critical Care, Guy's and St Thomas' NHS Foundation Trust, King's Health Partners, London, UK; Institute of Global Health Innovation, Imperial College London, London, UK.
  • Ahmad Guni
    Institute of Global Health Innovation, Imperial College London, London W2 1NY, UK; Department of Surgery and Cancer, Imperial College London, London, UK.
  • Ahmad Nabeel
    Institute of Global Health Innovation, Imperial College London, London, United Kingdom.
  • Ara Darzi
    Imperial College London London UK.
  • Hutan Ashrafian
    Institute of Global Health Innovation, Imperial College London, London, United Kingdom.