Towards Automated Screening of Literature on Artificial Intelligence in Nursing.

Journal: Studies in health technology and informatics
Published Date:

Abstract

We evaluate the performance of multiple text classification methods used to automate the screening of article abstracts in terms of their relevance to a topic of interest. The aim is to develop a system that can be first trained on a set of manually screened article abstracts before using it to identify additional articles on the same topic. Here the focus is on articles related to the topic "artificial intelligence in nursing". Eight text classification methods are tested, as well as two simple ensemble systems. The results indicate that it is feasible to use text classification technology to support the manual screening process of article abstracts when conducting a literature review. The best results are achieved by an ensemble system, which achieves a F1-score of 0.41, with a sensitivity of 0.54 and a specificity of 0.96. Future work directions are discussed.

Authors

  • Hans Moen
    Turku NLP Group, Department of Future Technologies, University of Turku, Finland.
  • Dari Alhuwail
    Information Science Department, College of Life Sciences, Kuwait University, Kuwait, Kuwait.
  • Jari Björne
    TurkuNLP group, Department of Future Technologies, University of Turku, Turku, Finland.
  • Lori Block
    School of Nursing, University of British Columbia Okanagan, Kelowna, Canada.
  • Sven Celin
    AIT Austrian Institute of Technology, Graz GmbH, Austria.
  • Eunjoo Jeon
    College of Nursing, Seoul National University.
  • Karl Kreiner
    AIT Austrian Institute of Technology, Austria.
  • James Mitchell
    School of Computing and Mathematics, Keele University, United Kingdom. Electronic address: j.a.mitchell@keele.ac.uk.
  • Gabriela Ožegović
    AIT Austrian Institute of Technology, Graz GmbH, Austria.
  • Charlene Esteban Ronquillo
    Daphne Cockwell School of Nursing, Faculty of Community Services, Ryerson University, Toronto, ON, Canada.
  • Lydia Sequeira
    Institute of Health Policy, Management and Evaluation, University of Toronto, (Ontario) Canada.
  • Jude Tayaben
    College of Nursing, Benguet State University, Philippines.
  • Maxim Topaz
    Division of General Internal Medicine and Primary Care, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, USA.
  • Sai Pavan Kumar Veeranki
    AIT Austrian Institute of Technology, Graz, Austria.
  • Laura-Maria Peltonen
    Nursing Science, University of Turku, and Turku University Hospital, Turku, Finland.