Applying language models for suicide prevention: evaluating news article adherence to WHO reporting guidelines.

Journal: Npj mental health research
Published Date:

Abstract

The responsible reporting of suicide in media is crucial for public health, as irresponsible coverage can potentially promote suicidal behaviors. This study examined the capability of generative artificial intelligence, specifically large language models, to evaluate news articles on suicide according to World Health Organization (WHO) guidelines, potentially offering a scalable solution to this critical issue. The research compared assessments of 40 suicide-related articles by two human reviewers and two large language models (ChatGPT-4 and Claude Opus). Results showed strong agreement between ChatGPT-4 and human reviewers (ICC = 0.81-0.87), with no significant differences in overall evaluations. Claude Opus demonstrated good agreement with human reviewers (ICC = 0.73-0.78) but tended to estimate lower compliance. These findings suggest large language models' potential in promoting responsible suicide reporting, with significant implications for public health. The technology could provide immediate feedback to journalists, encouraging adherence to best practices and potentially transforming public narratives around suicide.

Authors

  • Zohar Elyoseph
    The Institute for Research and Development, The Artificial Third, Tel Aviv, Israel.
  • Inbar Levkovich
    Faculty of Education, Tel-Hai Academic College, Upper Galilee 2208, Israel.
  • Eyal Rabin
    Department of Psychology and Education, The Open University of Israel, Israel. Electronic address: eyalra@openu.ac.il.
  • Gal Shemo
    Department of Psychology, The Center for Psychobiological Research, Max Stern Yezreel Valley College, Yezreel Valley, Israel.
  • Tal Szpiler
    Department of Psychology, The Center for Psychobiological Research, Max Stern Yezreel Valley College, Yezreel Valley, Israel.
  • Dorit Hadar Shoval
    The Center for Psychobiological Research, Department of Psychology and Educational Counseling, Max Stern Yezreel Valley College, Yezreel Valley, Israel. dorith@yvc.ac.il.
  • Yossi Levi Belz
    The Lior Tsfaty Center for Suicide and Mental Pain Studies, Ruppin Academic Center, Emek Hefer, Ruppin, Israel.

Keywords

No keywords available for this article.