ChatGPT sits the DFPH exam: large language model performance and potential to support public health learning.

Journal: BMC medical education
Published Date:

Abstract

BACKGROUND: Artificial intelligence-based large language models, like ChatGPT, have been rapidly assessed for both risks and potential in health-related assessment and learning. However, their applications in public health professional exams have not yet been studied. We evaluated the performance of ChatGPT in part of the Faculty of Public Health's Diplomat exam (DFPH).

Authors

  • Nathan P Davies
    Nottingham Centre for Public Health and Epidemiology, University of Nottingham, Nottingham City Hospital, Hucknall Rd, Nottingham, NG5 1PB, England. Nathan.davies@nottingham.ac.uk.
  • Robert Wilson
    European Molecular Biology Laboratory, European Bioinformatics Institute, Wellcome Genome Campus, Hinxton, Cambridge CB10 1SD, UK.
  • Madeleine S Winder
    Nottingham Centre for Public Health and Epidemiology, University of Nottingham, Nottingham City Hospital, Hucknall Rd, Nottingham, NG5 1PB, England.
  • Simon J Tunster
    Nottingham Centre for Public Health and Epidemiology, University of Nottingham, Nottingham City Hospital, Hucknall Rd, Nottingham, NG5 1PB, England.
  • Kathryn McVicar
    Nottingham Centre for Public Health and Epidemiology, University of Nottingham, Nottingham City Hospital, Hucknall Rd, Nottingham, NG5 1PB, England.
  • Shivan Thakrar
    Leicester City Council, Public Health, 115 Charles Street, Leicester, LE1 1FZ, England.
  • Joe Williams
    School of Health and Related Research (ScHARR), The University of Sheffield, 30 Regent St, Sheffield, S1 4DA, England.
  • Allan Reid
    NHS England, Seaton House, City Link, London Road, Nottingham, NG2 4LA, England.