Comparing machine and human reviewers to evaluate the risk of bias in randomized controlled trials.

Journal: Research synthesis methods
Published Date:

Abstract

BACKGROUND: Evidence from new health technologies is growing, along with demands for evidence to inform policy decisions, creating challenges in completing health technology assessments (HTAs)/systematic reviews (SRs) in a timely manner. Software can decrease the time and burden by automating the process, but evidence validating such software is limited. We tested the accuracy of RobotReviewer, a semi-autonomous risk of bias (RoB) assessment tool, and its agreement with human reviewers.

Authors

  • Susan Armijo-Olivo
    Institute of Health Economics (IHE), Edmonton, Alberta, Canada.
  • Rodger Craig
    Institute of Health Economics (IHE), Edmonton, Alberta, Canada.
  • Sandy Campbell
    Institute of Health Economics (IHE), Edmonton, Alberta, Canada.