Inter-reviewer reliability of human literature reviewing and implications for the introduction of machine-assisted systematic reviews: a mixed-methods review.

Journal: BMJ open
Published Date: Mar 19, 2024

Abstract

OBJECTIVES: Our main objective is to assess the inter-reviewer reliability (IRR) reported in published systematic literature reviews (SLRs). Our secondary objective is to determine the expected IRR by authors of SLRs for both human and machine-assisted reviews.

Authors

  • Piet Hanegraaf
    Pitts, Zeist, The Netherlands.
  • Abrham Wondimu
    Health-Ecore, Zeist, The Netherlands.
  • Jacob Jan Mosselman
    Pitts, Zeist, The Netherlands.
  • Rutger de Jong
    Pitts, Zeist, The Netherlands.
  • Seye Abogunrin
    F. Hoffmann-La Roche, Basel, Switzerland.
  • Luisa Queiros
    F. Hoffmann-La Roche, Basel, Switzerland.
  • Marie Lane
    F. Hoffmann-La Roche, Basel, Switzerland.
  • Maarten J Postma
    Department of Health Sciences, University Medical Centre Groningen, University of Groningen, Groningen, The Netherlands.
  • Cornelis Boersma
    Health-Ecore, Zeist, The Netherlands.
  • Jurjen van der Schans
    Health-Ecore, Zeist, The Netherlands jurjenvanderschans@health-ecore.com.

Keywords

External Resources

Popular Topics
Recent Journals