Performance and usability of machine learning for screening in systematic reviews: a comparative evaluation of three tools.

Journal: Systematic reviews
PMID:

Abstract

BACKGROUND: We explored the performance of three machine learning tools designed to facilitate title and abstract screening in systematic reviews (SRs) when used to (a) eliminate irrelevant records (automated simulation) and (b) complement the work of a single reviewer (semi-automated simulation). We evaluated user experiences for each tool.

Authors

  • Allison Gates
    Alberta Research Centre for Health Evidence (ARCHE), Department of Pediatrics, University of Alberta, 4-472, Edmonton Clinic Health Academy, 11405-87 Avenue NW, Edmonton, Alberta T6G 1C9, Canada.
  • Samantha Guitard
    Department of Pediatrics, Alberta Research Centre for Health Evidence and the University of Alberta Evidence-based Practice Center, University of Alberta, 11405 87 Ave NW, Edmonton, Alberta, T6G 1C9, Canada.
  • Jennifer Pillay
    Department of Pediatrics, Alberta Research Centre for Health Evidence and the University of Alberta Evidence-based Practice Center, University of Alberta, 11405 87 Ave NW, Edmonton, Alberta, T6G 1C9, Canada.
  • Sarah A Elliott
    Department of Pediatrics, Alberta Research Centre for Health Evidence and the University of Alberta Evidence-based Practice Center, University of Alberta, 11405 87 Ave NW, Edmonton, Alberta, T6G 1C9, Canada.
  • Michele P Dyson
    Department of Pediatrics, Alberta Research Centre for Health Evidence and the University of Alberta Evidence-based Practice Center, University of Alberta, 11405 87 Ave NW, Edmonton, Alberta, T6G 1C9, Canada.
  • Amanda S Newton
    Department of Pediatrics, University of Alberta Evidence-based Practice Center, University of Alberta, 11405 87 Ave NW, Edmonton, Alberta, T6G 1C9, Canada.
  • Lisa Hartling
    Alberta Research Centre for Health Evidence (ARCHE), Department of Pediatrics, University of Alberta, 4-472, Edmonton Clinic Health Academy, 11405-87 Avenue NW, Edmonton, Alberta T6G 1C9, Canada. Electronic address: hartling@ualberta.ca.