Performance of artificial intelligence chatbots in sleep medicine certification board exams: ChatGPT versus Google Bard.

Journal: European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery
Published Date:

Abstract

PURPOSE: To conduct a comparative performance evaluation of GPT-3.5, GPT-4 and Google Bard in self-assessment questions at the level of the American Sleep Medicine Certification Board Exam.

Authors

  • Ryan Chin Taw Cheong
    Otolaryngology-Head and Neck Surgery Department, The Royal Marsden NHS Foundation Trust, London, SW3 6JJ, UK. ryan.cheong@nhs.net.
  • Kenny Peter Pang
    Asia Sleep Centre, Singapore, Singapore.
  • Samit Unadkat
    Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Venkata Mcneillis
    Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Andrew Williamson
    Otolaryngology-Head and Neck Surgery Department, The Royal Marsden NHS Foundation Trust, London, SW3 6JJ, UK.
  • Jonathan Joseph
    Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Premjit Randhawa
    Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Peter Andrews
    Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Vinidh Paleri
    Head and Neck Unit, The Royal Marsden Hospitals NHS Foundation Trust, London, UK.