Attitudes and perceptions of medical researchers towards the use of artificial intelligence chatbots in the scientific process: an international cross-sectional survey.

Journal: The Lancet. Digital health
PMID: 39550312

Abstract

Chatbots are artificial intelligence (AI) programs designed to simulate conversations with humans that present opportunities and challenges in scientific research. Despite growing clarity from publishing organisations on the use of AI chatbots, researchers' perceptions remain less understood. In this international cross-sectional survey, we aimed to assess researchers' attitudes, familiarity, perceived benefits, and limitations related to AI chatbots. Our online survey was open from July 9 to Aug 11, 2023, with 61 560 corresponding authors identified from 122 323 articles indexed in PubMed. 2452 (4·0%) provided responses and 2165 (94·5%) of 2292 who met eligibility criteria completed the survey. 1161 (54·0%) of 2149 respondents were male and 959 (44·6%) were female. 1294 (60·5%) of 2138 respondents were familiar with AI chatbots, and 945 (44·5%) of 2125 had previously used AI chatbots in research. Only 244 (11·4%) of 2137 reported institutional training on AI tools, and 211 (9·9%) of 2131 noted institutional policies on AI chatbot use. Despite mixed opinions on the benefits, 1428 (69·7%) of 2048 expressed interest in further training. Although many valued AI chatbots for reducing administrative workload (1299 [66·9%] of 1941), there was insufficient understanding of the decision making process (1484 [77·2%] of 1923). Overall, this study highlights substantial interest in AI chatbots among researchers, but also points to the need for more formal training and clarity on their use.

Authors

  • Jeremy Y Ng
    Centre for Journalology, Methods Centre, Ottawa Hospital Research Institute, Ottawa, ON, Canada. Electronic address: ngjy2@mcmaster.ca.
  • Sharleen G Maduranayagam
    Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada.
  • Nirekah Suthakar
    Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada.
  • Amy Li
    Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada.
  • Cynthia Lokker
    Health Information Research Unit, Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada. Electronic address: lokkerc@mcmaster.ca.
  • Alfonso Iorio
    Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada.
  • R Brian Haynes
    Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada.
  • David Moher
    Centre for Journalology Clinical Epidemiology Program Ottawa Hospital Research Institute Ottawa Canadá Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canadá.

Keywords

External Resources

Popular Topics
Recent Journals