Using artificial intelligence tools to automate data extraction for living evidence syntheses.

Journal: PloS one
PMID:

Abstract

Living evidence synthesis (LES) involves repeatedly updating a systematic review or meta-analysis at regular intervals to incorporate new evidence into the summary results. It requires a considerable amount of human time investment in the article search, collection, and data extraction phases. Tools exist to automate the retrieval of relevant journal articles, but pulling data out of those articles is currently still a manual process. In this article, we present a proof-of-concept Python program that leverages artificial intelligence (AI) tools (specifically, ChatGPT) to parse a batch of journal articles and extract relevant results, greatly reducing the human time investment in this action without compromising on accuracy. Our program is tested on a set of journal articles that estimate the mean incubation period for COVID-19, an epidemiological parameter of importance for mathematical modelling. We also discuss important limitations related to the total amount of information and rate at which that information can be sent to the AI engine. This work contributes to the ongoing discussion about the use of AI and the role such tools can have in scientific research.

Authors

  • Evan Mitchell
    Department of Mathematics and Statistics, McMaster University, Hamilton, ON,Canada.
  • Elisha B Are
    Department of Mathematics, Simon Fraser University, Burnaby, BC,Canada.
  • Caroline Colijn
    Department of Mathematics, Simon Fraser University, Burnaby, British Columbia, Canada V5A 1S6.
  • David J D Earn
    Department of Mathematics and Statistics, McMaster University, Hamilton, ON,Canada.