Current safeguards, risk mitigation, and transparency measures of large language models against the generation of health disinformation: repeated cross sectional analysis.

Journal: BMJ (Clinical research ed.)
PMID:

Abstract

OBJECTIVES: To evaluate the effectiveness of safeguards to prevent large language models (LLMs) from being misused to generate health disinformation, and to evaluate the transparency of artificial intelligence (AI) developers regarding their risk mitigation processes against observed vulnerabilities.

Authors

  • Bradley D Menz
    College of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, Australia.
  • Nicole M Kuderer
    Advanced Cancer Research Group, Kirkland, WA, USA.
  • Stephen Bacchi
    Faculty of Health and Medical Sciences, Adelaide Medical School, University of Adelaide, Adelaide, SA 5000 Australia.
  • Natansh D Modi
    College of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, Australia.
  • Benjamin Chin-Yee
    Schulich School of Medicine and Dentistry, Western University, London, Canada.
  • Tiancheng Hu
    Language Technology Lab, University of Cambridge, Cambridge, UK.
  • Ceara Rickard
    Consumer Advisory Group, Clinical Cancer Epidemiology Group, College of Medicine and Public Health, Flinders University, Adelaide, Australia.
  • Mark Haseloff
    Consumer Advisory Group, Clinical Cancer Epidemiology Group, College of Medicine and Public Health, Flinders University, Adelaide, Australia.
  • Agnes Vitry
    University of South Australia, Clinical and Health Sciences, Adelaide, Australia.
  • Ross A McKinnon
    College of Medicine and Public Health, Flinders University, Adelaide, SA, 5042, Australia.
  • Ganessan Kichenadasse
    College of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, Australia; Flinders Centre for Innovation in Cancer, Department of Medical Oncology, Flinders Medical Centre, Flinders University, Bedford Park, South Australia, Australia.
  • Andrew Rowland
    College of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, Australia.
  • Michael J Sorich
    Flinders Health and Medical Research Institute, College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia.
  • Ashley M Hopkins
    Flinders Health and Medical Research Institute, College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia.